Image data processing apparatus, medium recording image data set, medium recording image data processing program and image data processing method

ABSTRACT

There has been a problem in that original image data should be saved with another name so as not to be altered, resulting in complexity and an increase in a necessary storage region.  
     Image data are housed in a folder managed as a film metaphor and a database of photographic data  30   b  corresponding to each image data is prepared. When a desirable image processing is selected for desirable image data, the selected image processing is updated as modification information in the database structure. When display, output or print is actually required, various image processings are executed by referring to modification information on only a work area with original image data left. Therefore, it is possible to easily enjoy image modification or the like with the original image data left as they are.

TECHNICAL FIELD

[0001] The present invention relates to an image data processingapparatus capable of properly modifying and utilizing image data, amedium recording an image data set, a medium recording an image dataprocessing program and an image data processing method.

BACKGROUND ART

[0002] In recent years, a digital still camera has been utilizedrapidly. In the case in which photographing is carried out by means ofthe digital still camera, an image can be managed as data andmodification and the like can be performed easily. For example, imagedata can easily give the fact that a dark image can be modified to bebrighter and the color of the sky can be bluer for beauty.

[0003] Such a processing has widely been utilized as an imageprocessing. If image data to be input is subjected to a processing, newimage data are obtained and are overwritten in an original storageregion.

DISCLOSURE OF THE INVENTION

[0004] In the above-mentioned conventional image data processingapparatus, there has been the following problem.

[0005] First of all, original image data are changed. The image dataprocessing apparatus is not preferable for utilization if importance isattached to the original image data. As a matter of course, it is alsopossible to carry out a processing in which the original image data areonce saved and are further saved with another name. However, thisprocessing is complicated and causes a required storage region to beincreased. In that case, moreover, the individual management of theoriginal image data and the modified image data is very complicated.

[0006] Furthermore, picture quality is more deteriorated for eachrewriting in a certain kind of image format. In this sense, therefore,even if the modification is slightly carried out, the picture quality isdeteriorated.

[0007] In consideration of the above-mentioned problem, it is an objectof the present invention to provide an image data processing apparatuscapable of referring to a result obtained by easily carrying out animage processing while maintaining the originality of image data, amedium recording an image data set, a medium recording an image dataprocessing program and an image data processing method.

[0008] In order to achieve the above-mentioned object, a first aspect ofthe present invention is directed to an image data processing apparatuscomprising a parameter setting unit which sets a parameter representingcontents of a predetermined image processing to be executed on imagedata, a data saving unit which saves the image data and the parametertogether with relating information, a data acquiring unit which acquiresthe image data and the parameter by referring to the relatinginformation, and an image processing reproducing unit which obtainsimage data subjected to the specified image processing based on theacquired image data and parameter.

[0009] A second aspect of the present invention is directed to an imagedata processing apparatus comprising a parameter setting unit which setsa parameter representing contents of a predetermined image processing tobe executed on image data, and a data saving unit which saves the imagedata and the parameter together with relating information, and a thirdaspect of the present invention is directed to an image data processingapparatus in which a parameter representing contents of a predeterminedimage processing to be executed on image data and the image data aresaved together with mutual relating information, the apparatuscomprising a data acquiring unit which acquires the image data and theparameter by referring to the relating information, and an imageprocessing reproducing unit which obtains image data subjected to thespecified image processing based on the acquired image data andparameter.

[0010] According to the first aspect of the present invention having theabove-mentioned structure, when the parameter setting unit sets aparameter representing contents of a predetermined image processing tobe executed on image data, the data saving unit saves the image data andthe parameter together with relating information. When the dataacquiring unit acquires the image data and the parameter by referring tothe relating information, the image processing reproducing unit obtainsimage data subjected to the specified image processing based on theacquired image data and parameter.

[0011] More specifically, the parameter representing the contents of theimage processing are stored in relation to the image data. For example,also in the case in which the image processing is carried out, theoriginal image data are not altered but are managed as a parameter. Ifnecessary, image data subjected to the image processing based on theparameter are obtained. The result of the image processing can beutilized and the original image data are left as they are.

[0012] According to the second and third aspects of the presentinvention, the whole present invention is carried out partially.

[0013] According to the fourth aspect of the present invention havingthe above-mentioned structure, the type or degree of the imageprocessing is represented by the parameter. Consequently, the contentsof the image processing are shown more specifically. As a matter ofcourse, the types and degrees of a plurality of image processings arealso represented.

[0014] According to the fifth aspect of the present invention having theabove-mentioned structure, furthermore, a plurality of parameters areprepared every type of the image processing. Therefore, a certain typeof image processing is not always restricted to one content but aplurality of contents can be left. For example, one image processingadjusts a sharpness, and a parameter representing a high enhancementdegree of the sharpness and a parameter representing a low enhancementdegree of the sharpness are saved, any of which is selected duringreproduction. In the case in which the reproduced image data are to beprinted, an optimum enhancement degree of the sharpness is sometimeschanged by the resolution of a printing device. Corresponding to such acase, a plurality of parameters can also be left.

[0015] According to the sixth aspect of the present invention having theabove-mentioned structure, furthermore, a plurality of parameters whichcan be saved can be executed selectively. For example, consequently, inthe cases in which a sufficient time can be obtained for the imageprocessing and the image processing should be carried out in a veryshort time, the same picture quality is not always required. For thelatter, therefore, an image processing which can be implemented at a lowload can be carried out. Accordingly, in the case of a slide show, animage processing corresponding to a parameter according to the executionof the slide show is carried out. In the case of print, an imageprocessing is executed according to a parameter corresponding thereto.As a matter of course, execution conditions may be determined for thisselection to select and execute the processing which satisfies thecondition at the time of the execution or a user may specify thecondition.

[0016] According to the seventh aspect of the present invention havingthe above-mentioned structure, moreover, the execution order informationof the parameter is also provided on the premise that there are aplurality of parameters. Consequently, when the image processing iscarried out according to the execution order information, it isperformed in time series. Correspondingly, if the parameter is left foreach operation, such a parameter represents a plurality of histories intime series. Accordingly, the image is reproduced by faithfully passingthrough the image processing process in progress. As a matter of course,it is not necessary to execute all the processings and the processingcan be halted to reproduce a reproducing process.

[0017] According to the eighth aspect of the present invention havingthe above-mentioned structure, furthermore, the parameter is dividedinto a plurality of sets which can be selected optionally. Thus, theimage processing can be carried out based on the parameters of the setsselected according to the situation of the execution.

[0018] More specifically, only one result of the image processing is notrestricted but a plurality of results of the image processing can beselected. For example, an image processing for clear display on adisplay and an image processing for clear printing are different fromeach other in many cases. In such cases, it is advantageous that aparameter for the display on the display and a parameter for theprinting can be stored together. Moreover, it is suitable that parametersets can be prepared for each size and each user to correspond to anoutput size as well as an output destination and to share one image databy a plurality of users.

[0019] According to the ninth aspect of the present invention having theabove-mentioned structure, furthermore, the parameter is divided into aplurality of sets, and an image processing corresponding to thesituation of a pixel is applied. More specifically, the parameter setsare applied ununiformly to the image data. For example, the parametersets are used separately according to the position of the pixel or thecolor of the pixel. The region is divided into the central portion of animage, a specific range which is designated in advance and upper andlower half portions, thereby causing different sets of parameters toapply to the position of the pixel. Moreover, if the color of the pixelis divided into a skin color region, a blue color region and a region ofthe bright colors of the sunset, an optimum parameter according to asubject can almost be applied.

[0020] According to the tenth aspect of the present invention having theabove-mentioned structure, furthermore, the storage region ispartitioned as a hierarchical structure, and the image data and theparameter are divided by the hierarchical structure. The partitionedportion itself also represents a relation. Moreover, for thecorrespondence of the image data to the parameter, the parameter may bestored in the same section or a corresponding hierarchical structure maybe provided in another region to store the same parameter.

[0021] According to the eleventh aspect of the present invention havingthe above-mentioned structure, furthermore, the thumb nail having asmall capacity is caused to previously correspond with the same level asthe correspondence of the parameter. The thumb nail data can also bemanaged by a processing to be carried out in parallel with themanagement of the parameter.

[0022] According to the twelfth aspect of the present invention havingthe above-mentioned structure, furthermore, the image data and theparameter are managed on the different storage devices. For example, theimage data are sometimes managed in a plurality of removable storageregions. In this case, writing cannot be always carried out depending onthe storage region. In a write disable storage region, the parameter canbe managed in a write enable storage region.

[0023] In some storage regions, the writing can be carried out butcannot be properly performed. For example, several people often sharethe storage region through a network. Any of them should prevent therewriting of the shared image data without permission. In such a case,the image data are managed in the write enable storage region togetherwith a shared region as the storage region which is not suitable for thewriting. Referring to the image data in the storage region which is notsuitable for the writing, the parameter is managed in the write enableregion. As a matter of course, the same problems sometimes arise inaddition to the network and the shared region. In any case, theparameter is managed in the storage region which is suitable for thewriting.

[0024] According to the thirteenth aspect of the present inventionhaving the above-mentioned structure, furthermore, the parameter settingunit sets the contents of the image processing represented by theparameter based on the result obtained by statistically analyzing theimage data. More specifically, the present invention is applied to theautomatic processing.

[0025] According to the fourteenth aspect of the present inventionhaving the above-mentioned structure, furthermore, the image processingreproducing unit selects the corresponding image processing sectionbased on the parameter, thereby executing the image processing to becarried out for reproducing the result of the image processing. Themeans for implementing the image processing can be selected by thevarious methods as an example of implementation on a computer.Irrespective of the inside or outside, the method can be selected forthe implementation. More specifically, an image processing sectioncorresponding to an image processing having a different version can beselected, an image processing section provided by an operating system ofa computer or the like can be selected and activated, or a necessaryimage processing section can be searched from a network or the like andbe activated.

[0026] Thus, it can be easily understood that a measure for relating andsaving the parameter representing the contents of the image processingwithout changing the image data by the execution of the image processingis not restricted to a substantial apparatus but can function as amethod thereof. More specifically, it is obvious that the substantialapparatus is not always used but the method can also be usedeffectively.

[0027] Moreover, such an image data processing apparatus is provided byitself or is incorporated and utilized in another equipment in somecases. The thought of the invention is not restricted but includesvarious manners. Accordingly, a software or a hardware can be usedproperly.

[0028] As a concrete example of the thought of the invention, in thecase in which the present invention is applied to the software of theimage data processing apparatus, it is present and utilized on arecording medium recording such a software as a matter of course. Thus,the present invention is established as the software itself.Accordingly, each invention as a medium described in this specificationcorresponds to a recorded program itself at a ratio of one to one.

[0029] As a matter of course, the recording medium may be a magneticrecording medium or an optical magnetic recording medium, and so is anyrecording medium which will be developed in the future. Moreover, aduplicating stage such as a primary reproduced article, a secondaryreproduced article or the like is quite the same. Moreover, also in thecase in which a communicating line is utilized as a supply method, thepresent invention is utilized.

[0030] Furthermore, also in the case in which a software and a hardwareare partially used for implementation, the thought of the invention isnot quite different. It is also possible to use such a configurationthat a part of data may be stored on the recording medium and may beproperly read if necessary.

[0031] In order to thus reproduce the image data, the medium recordingthe image data set is indispensable and the present invention can alsobe implemented in such a configuration.

BRIEF DESCRIPTION OF THE DRAWINGS

[0032]FIG. 1 is a diagram showing the schematic structure of an imagedata processing apparatus according to an embodiment of the presentinvention corresponding to claims.

[0033]FIG. 2 is a block diagram showing a specific hardware of the imagedata processing apparatus.

[0034]FIG. 3 is a functional block diagram showing the image dataprocessing apparatus.

[0035]FIG. 4 is a block diagram showing a common function section.

[0036]FIG. 5 is a functional block diagram showing a film data managingsection.

[0037]FIG. 6 is a schematic diagram showing a data structure to bemanaged by the film data managing section.

[0038]FIG. 7 shows a variable declaration of a management parameter.

[0039]FIG. 8 is a functional block diagram showing an image modificationcontrol section.

[0040]FIG. 9 is a chart showing the flow of a procedure for explainingthe image modification control.

[0041]FIG. 10 is a diagram showing the structure of an image file.

[0042]FIG. 11 is a diagram showing a state in which a pixel to beprocessed is moved.

[0043]FIG. 12 is a chart showing a distribution range for theenlargement of a luminance distribution.

[0044]FIG. 13 is a chart showing a conversion relationship for theenlargement of the luminance distribution.

[0045]FIG. 14 is a chart showing an end processing for the luminancedistribution and an end obtained by the end processing.

[0046]FIG. 15 shows a conversion table for the enlargement of theluminance distribution.

[0047]FIG. 16 is a chart showing a concept for making bright by γcorrection.

[0048]FIG. 17 is a chart showing a concept for making dark by the γcorrection.

[0049]FIG. 18 is a chart showing the correspondence relationship of aluminance altered by the γ correction.

[0050]FIG. 19 is a table showing the correspondence relationship betweena brightness evaluation and γ.

[0051]FIG. 20 is a chart showing a method for extracting an element tobe a feature vector for each color component.

[0052]FIG. 21 is a schematic chart showing the summarization state of acolor saturation distribution.

[0053]FIG. 22 is a chart showing the relationship between a colorsaturation and a color saturation enhancement exponent.

[0054]FIG. 23 is a chart illustrating the case in which a degree ofchange of an image is represented by each component value of orthogonalcoordinates.

[0055]FIG. 24 is a diagram illustrating the case in which the degree ofchange of an image is obtained with a difference value in adjacentpixels in the directions of an axis of ordinate and an axis of abscissa.

[0056]FIG. 25 is a diagram illustrating the case in which the degree ofchange of an image is obtained between all the adjacent pixels.

[0057]FIG. 26 is a diagram showing an example of image data.

[0058]FIG. 27 is a diagram showing an unsharp mask having 5×5 pixels.

[0059]FIG. 28 is a flowchart showing the case in which automatic imageadjustment is specified.

[0060]FIG. 29 is a flowchart showing the case in which manual imageadjustment is specified.

[0061]FIG. 30 is a flowchart showing the case in which trimming isspecified.

[0062]FIG. 31 is a flowchart showing the case in which rotation isspecified.

[0063]FIG. 32 is a flowchart showing the case in which modificationcancellation is specified.

[0064]FIG. 33 is a flowchart showing a processing capable of utilizingmodified image data.

[0065]FIG. 34 is a diagram showing an operation screen for asimultaneous print processing.

[0066]FIG. 35 is a diagram showing an operation screen for newlyfetching image data.

[0067]FIG. 36 is a diagram showing an operation screen for carrying outan automatic image modification processing.

[0068]FIG. 37 is a diagram showing an operation screen for executing theautomatic image modification in default.

[0069]FIG. 38 is a diagram showing an operation screen for carrying outa trimming processing.

[0070]FIG. 39 is a diagram showing an operation screen for carrying outa rotation processing.

[0071]FIG. 40 is a diagram showing an operation screen for carrying outan automatic image adjustment processing.

[0072]FIG. 41 is a diagram showing an operation screen for carrying outa manual image adjustment processing.

[0073]FIG. 42 is a diagram showing an operation screen for carrying outa modification cancellation processing.

[0074]FIG. 43 is a diagram showing an operation screen for carrying outa print specification processing.

[0075]FIG. 44 is a diagram showing an operation screen for carrying outan album print processing.

[0076]FIG. 45 is a diagram showing an operation screen for carrying outa print processing.

[0077]FIG. 46 is a functional block diagram showing a DPE print controlsection.

[0078]FIG. 47 is a diagram showing a directory structure.

[0079]FIG. 48 is a diagram showing a variant of a file structure.

[0080]FIG. 49 is a diagram showing another variant of the filestructure.

[0081]FIG. 50 is a flowchart showing a processing of generating a workimage file.

[0082]FIG. 51 shows an example of definition of a variable to be usedfor the processing of generating a work image file.

[0083]FIG. 52 is a flowchart showing a thumb nail display processing.

[0084]FIG. 53 is a table showing the contents of modificationinformation.

[0085]FIG. 54 is a flowchart showing an example of a modificationprocessing.

[0086]FIG. 55 is a conceptual diagram showing the modificationprocessing.

[0087]FIG. 56 is a table showing the contents obtained when there are aplurality of modification information.

[0088]FIG. 57 is a flowchart showing a modification processing to becarried out when a plurality of groups have modification information.

[0089]FIG. 58 is a part of the flowchart showing a modificationprocessing to be carried out when a plurality of groups havemodification information.

[0090]FIG. 59 is a part of a flowchart showing a modification processingto be carried out by causing the group to correspond to an environment.

[0091]FIG. 60 is a flowchart showing a modification operation to becarried out when a plurality of groups have history modificationinformation.

[0092]FIG. 61 is a flowchart showing a modification processing to becarried out when a modification history is implemented by a plurality ofgroups.

[0093]FIG. 62 is a flowchart showing a modification operation to becarried out when a part of an image is modified.

BEST MODE OF CARRYING OUT THE INVENTION

[0094] <First Embodiment>

[0095] An embodiment of the present invention will be described belowwith reference to the drawings.

[0096]FIG. 1 is a diagram showing the corresponding schematic structureof an image data processing apparatus according to the embodiment of thepresent invention.

[0097] Image data photographed by a digital still camera or the like aremanaged by utilizing an external storage device such as a computer orthe like. A data saving unit A1 corresponding to the external storagedevice or the like stores a plurality of image data and parameterscorresponding thereto in relation to each other, and carries outmanagement such as proper change, addition, deletion or the like bydatabase management by a computer.

[0098] In order to carry out such management, the data saving unit A1keeps an image data storage region A11, a parameter storage region A12and a relating information storage region A13. While the image datastorage region A11 stores image data, it may have a batch databasestructure or may store individual files. The parameter storage regionA12 is information indicative of an instruction for an image processingto individual image data and has a comparative smaller capacity than theimage data. Also in this case, a batch database structure may beprovided or individual files may be generated. The relating informationstorage region A13 records relating information for relating a parameterstored in the parameter storage region A12 and image data stored in theimage data storage region A11. Thus, there are various relating methods.As an example, if the database structure of a parameter is formed andconstituted as index information, the parameter storage region A12 andthe relating information storage region A13 are implemented inseparablyintegrally. As a matter of course, the image data storage region A11includes removable recording media and the like. Moreover, the imagedata storage region A11, the parameter storage region A12 and therelating information storage region A13 do not need to be the samedevices physically. Furthermore, the image data storage region A11 maybe a shared region to be accessed by a plurality of devices and thelike.

[0099] Moreover, if a parameter representing the contents of an imageprocessing by the management operation or arithmetic operation of theimage data and the like is set by means of a parameter setting unit A2which is implemented by an input-output apparatus of a computer itselfand the result of an arithmetic operation of the computer itself, thedata saving unit A1 relates a corresponding parameter to image data toexecutes a management processing through the database management. Inthis case, relating information is generated. The parameter setting unitA2 serves to generate a parameter as a result, and includes the case inwhich an instruction for an image processing from a user through a GUIis accepted to set a parameter and the case in which image data areoriginally inspected to set a parameter for implementing an imageprocessing to meet a predetermined purpose. The relating information canbe variously utilized, for which a correspondence table may be prepared,a file name may be related and saving regions may be made coincidentwith each other for relations.

[0100] In the data saving unit A1, thus, image data and a parameterrepresenting the contents of an image processing to be executed for theimage data are related by the relating information and are saved. A dataacquiring unit A4 acquires image data and parameters corresponding basedon the information of the relating information storage region A13 fromthe image data storage region A11 and the parameter storage region A12in the data saving unit A1, and outputs them to an image processingreproducing unit A3. In general, the data acquiring unit A4 also acceptsan instruction for image selection from the user through the GUI andspecifies image data to be acquired. A specifying method is notrestricted. In a computer or the like, for example, a predeterminedargument is given from an external application to specify object imagedata. Consequently, the image data can be specified and acquired and besimultaneously transferred to the image processing reproducing unit A3.Moreover, a manner for acquiring the image data is changed by a specifichardware. Also in the case in which the image data are simply set to avariable in an expanded state on a memory, it can be considered that theimage data are acquired.

[0101] The image processing reproducing unit A3 serves to implement amodification processing corresponding to a parameter and includes aplurality of modifying engines A31 to A3 n. When image data and aparameter are given, each modifying engine A3 x carries out modificationcorresponding to each modifying engine A3 x represented by the sameparameter on the image data and newly generates and outputs modifiedimage data. The image data are treated as an original and the modifiedimage data are newly generated. As a matter of course, the originalimage data can be freely overwritten by the newly generated image data,and may be overwritten and saved in the image data storage region A11 inthe data saving unit A1. A plurality of modifying engines A31 to A3 nare provided in such a meaning that various kinds of conversion resultsare obtained. One modifying engine may be substantially provided toobtain various kinds of results of conversion depending on the parameteror the modifying engines may be individually prepared to obtainindividual results of conversion, respectively. Moreover, the modifyingengines A31 to A3 n do not always include applications themselvestherein but the modifying engines A31 to A3 n provided externally may beselected.

[0102] The data saving unit A1, the parameter setting unit A2, the imageprocessing reproducing unit A3 and the data acquiring unit A4 are notrestricted to a single hardware but can be implemented by utilizing ageneral-purpose computer system 10. In the case in which theabove-mentioned structure is thus implemented by a software, they areimplemented as a data saving step A1, a parameter setting step A2, adata acquiring step A4 and an image reproducing processing step A3,respectively.

[0103] In the present embodiment, the computer system 10 is employed asan example of a hardware for implementing such an image data processingapparatus.

[0104]FIG. 2 is a block diagram showing the computer system 10.

[0105] The computer system 10 includes a scanner 11 a, a digital stillcamera 11 b and a video camera 11 c as image input devices for directlyinputting image data which are connected to a computer body 12. Therespective input devices can generate image data representing an imageby a pixel in a dot matrix and output them to the computer body 12. Thesame image data can be displayed in 256 gradations in primaries of RGB,thereby representing approximately 16700000 colors.

[0106] A floppy disk drive 13 a, a hard disk 13 b and a CD-ROM drive 13c are connected as external auxiliary storage devices to the computerbody 12. The hard disk 13 b records a system-related main program, andcan properly read a necessary program from the floppy disk, the CD-ROMand the like.

[0107] Moreover, a modem 14 a is connected as a communicating device forconnecting the computer body 12 to an external network or the like, andcan be connected to an external network through a public communicatingline to download and introduce a software and data. In this example,access can be given to the outside by the modem 14 a through a telephoneline. It is also possible to use a structure in which access is given tothe network through a LAN adapter.

[0108] Referring to the floppy disk drive 13 a and the CD-ROM drive 13 cas the external auxiliary storage devices, recording media themselvescan be exchanged. With the supply of image data recorded in therecording media, they can also act as image input devices. Moreover, inthe case in which access is given to a network through the modem 14 aand the LAN adapter, image data can also be supplied from this network.Also in this cases, they can act as the image input devices. The networkis accessed to acquire a part of a program and another program which canbe activated externally in addition to the case in which data are to beacquired. Consequently, it is also possible to acquire the modifyingengine partially or wholly from the outside or to cause external devicesto execute the processing.

[0109] Moreover, a keyboard 15 a and a mouse 15 b acting as a pointingdevice are also connected for the operation of the computer body 12, andfurthermore, a speaker 18 a and a microphone 18 b are provided formultimedia correspondence.

[0110] Furthermore, a display 17 a and a color printer 17 b are providedas image output devices. The display 17 a has a display area having 800pixels in a horizontal direction and 600 pixels in a vertical directionand can display the above-mentioned 16700000 colors for each pixel. As amatter of course, this resolution is one of examples and can be properlychanged to 640×480 pixels, 1024×768 pixels and the like.

[0111] Moreover, the color printer 17 b acting as a printer is an inkjet printer, and can use a four-color ink of CMYK to attach a dot on aprint paper as a recording medium, thereby printing an image. While highdensity printing having an image density of 360×360 dpi and 720×720 dpican be carried out, two-gradation expression is used as to whether ornot a color ink is attached. The color ink is not restricted to the fourcolors but can also have six colors having light cyan and light magenta,thereby reducing the loudness of the dot. Furthermore, anelectrostatographic method utilizing a color toner or the like can alsobe employed in place of the ink jet method. Moreover, the printer doesnot need to be a color printer but may be a black and white printer. Aswill be described below, an optimum image processing can also be carriedout corresponding to black and white reproduction. If image data aresubjected to such an image processing, a disadvantage is caused in thecase in which color reproduction is to be carried out again. In thepresent invention, however, original image data are strictly left andsuch an image processing can easily be carried out.

[0112] In order to input an image by using such an image input deviceand to display or output the image to an image output device, apredetermined program is executed in the computer body 12. An operatingsystem (OS) 12 a is activated as a basic program. In the operatingsystem 12 a are incorporated a display driver (DSP DRV) 12 b for causingthe display 17 a to perform display and a printer driver (PRT DRV) 12 cfor causing the color printer 17 b to perform print and output. Thesedrivers 12 b and 12 c depend on the types of the display 17 a and thecolor printer 17 b, and can be added and changed for the operatingsystem 12 a depending on the respective types. Moreover, it is alsopossible to implement more additional functions than a standardprocessing depending on the respective types. More specifically, it ispossible to implement various additional processings within an allowablerange while maintaining a processing system which is shared on astandard system such as the operating system 12 a.

[0113] As a matter of course, the computer body 12 includes a CPU 12 e,a RAM 12 f, a ROM 12 g, an I/O 12 h and the like as a premise that sucha program is executed. The CPU 12 e for executing an arithmeticoperation uses the RAM 12 f as a temporary work area or a set storageregion or as a program region to properly execute the basic programwritten to the ROM 12 g, thereby controlling external and internalapparatuses and the like which are connected through the I/O 12 h.

[0114] An application 12 d is executed on the operating system 12 a asthe basic program. The application 12 d has various processing contents,and monitors the operations of the keyboard 15 a and the mouse 15 b asthe operating devices, properly controls various external apparatuses toexecute a corresponding arithmetic operation during the operation, andfurthermore, displays the result of the processing on the display 17 aand outputs the same to the color printer 17 b.

[0115] In such a computer system 10, a photograph or the like can beread by the scanner 11 a as an image input device or the like to acquireimage data, and furthermore, image data picked up the digital stillcamera 11 b can be acquired and image data can be acquired as a dynamicimage picked up by the video camera 11 c. Moreover, various image datapreviously picked up are provided as a CD-ROM software very often, andthe image data are previously saved in one storage region to which aplurality of people often give access through a network.

[0116] The image data picked up by the digital still camera 11 b areoften saved collectively in the hard disk 13 b. Such image data areenjoyed on the display 17 a, and furthermore, are output for enjoymentby the color printer 17 b. As an advantage of the image data, a poorpicture can easily be modified. More specifically, since original imagedata give a poor picture or the like for the printing by the colorprinter 17 b, modification is carried out by photoretouch or the like.Thus, an image data processing apparatus for managing image data andmodifying an image is required. Consequently, the application 12 d andthe computer system 10 are organically integrated to implement the imagedata processing apparatus.

[0117] In this sense, the application 12 d which is an image dataprocessing software stores and manages the image data picked up by thedigital still camera 11 b in the hard disk 13 b, carries out managementsuch that image data supplied from the CD-ROM through the CD-ROM drive13 c can be properly input, and manages a parameter as will be describedbelow. Accordingly, the data saving unit A1 is constituted by a softwareand a hardware which are related to each other in this sense.

[0118] For the image data thus stored, moreover, a processing object isspecified by the application 12 d and an image processing is carried outby an inner image processing routine together with the above-mentionedcorresponding parameter. The image processing reproducing unit A3 isconstituted by a software and a hardware which are related to each otherin this sense.

[0119] The application 12 d inputs the operations of the keyboard 15 aand the mouse 15 b through the operating system 12 a and generates apredetermined corresponding screen to be displayed on the display 17 a.In such a sense that the object image data are selected through the GUIprocessing to specify an image processing to be executed, the parametersetting unit A2 is constituted by a software and a hardware which arerelated to each other. Furthermore, the data acquiring unit A4 isconstituted by a software and a hardware which are related to each otherin such a meaning that a parameter is read to execute a prespecifiedimage processing when reading the saved image data.

[0120] Such a software is stored in the hard disk 13 b and is read andactivated by the computer body 12. During introduction, the software isrecorded and installed in a medium such as a CD-ROM 13 c-1, a floppydisk 13 a-1 or the like. Accordingly, these media record the image dataprocessing programs.

[0121]FIG. 3 is a block diagram showing the contents of control by theimage data processing software, which are constituted by a main controlsection 60 for carrying out various general control operations, a commonfunction section 20 for carrying out various common control operations,a film data managing section 30 for managing image data, an imagemodifying control section 40 for executing image modification for eachimage data and a DPE print control section 50 for executing a series ofprinting processings.

[0122] The main control section 60 properly selects and executes variousflows which will be described below, and also executes various otherfunctions which are not classified. One of them is an environmentsetting section 60 a which can record, as a set information file 60 b,common setting in the image data processing software and the like on thehard disk 13 b and can properly perform reading from other functionsections. For the set information file 60 b, various defaultspecifications, for example, the specification of the fetch source ofnew image data, a parameter for a page to be continued next time in aprinting processing which will be described below and the like arerecorded.

[0123] The common function section 20 is shown in a detailed block ofFIG. 4, some of which can be called from other function sections incommon. For example, an image selecting section 20 a causes the display17 a to display a plurality of thumb nail images in an image displaysection 20 m while creating a thumb nail for each image data in a thumbnail creating section 20 i, and accepts a selecting operation by thekeyboard 15 a and the mouse 15 b in that state, thereby inputting thepresence of the selection for each image. As a matter of course, in thecase in which the display is to be changed by the selecting operation,the display is properly changed by the image display section 20 m andthe result of selection is transferred to other function sections.Moreover, a display specifying section 20 b serves to specify thedisplay on a screen and to properly specify the display of an imagecorresponding to the change of the size of a window region or the likedepending on a GUI operation.

[0124] A file editing section 20 c serves to execute an operation forproperly changing a saving region of image data and the like, and aretrieving section 20 d serves to execute retrieval according to acomment, a date and the like based on a parameter managed together withan image file. A batch comment section 20 e serves to process a commentfor a plurality of image data in batches, and a batch filing section 20f serves to process image data and parameters in batches at the sametime.

[0125] The image modification control section 40 mainly generatesvarious parameters for automatically executing an image processing,while an image processing section 20 g and an image editing section 20 hare portions which actually execute the image processing and alsoexecute the specified image processings manually. The results of theprocessings are treated as dummy data in principle, and are reflected byoriginal image data if a specification for changing the original imagedata is given during an actual processing. Moreover, the processings donot need to be always executed based on the original image data forconvenience of a display and a time required for the processing but theimage processing section 20 g and the image editing section 20 h executevarious processings based on the image data of a thumb nail during theoperation.

[0126] In the case in which the storage region of the image data hasalready been registered by the file editing section 20 c, an image inputsection 20 j carries out a processing of reading the same image dataduring an image processing and a print processing. Moreover, an imageoutput section 20 k carries out a processing of converting a format tobe output corresponding to the presence of various data formats as imagedata.

[0127] Next, a film data managing section 30 will be described below.FIG. 5 is a block diagram showing the management structure of an imagefile 30 which is image data managed by the film data managing section30, photographic data 30 b including a parameter and film data 30 cutilizing the grouping of the image data. Since the image data aretreated as a file in the computer system 10, it is indicated as an imagefile and the parameter is indicated as the photographic data 30 btogether with various information corresponding to the respective imagedata. Moreover, the film data 30 c is information for grouping andmanaging the image data and is shown as a film metaphor in FIG. 6. Thedatabase of the photographic data 30 b is saved in the storage regionwhich can be rewritten on the computer system 10, and furthermore, issaved in a constant region irrespective of a plurality of filmmetaphors. As a matter of course, it is possible to physically set aplurality of databases. In brief, it is not always necessary to form thedatabase in a medium in which the image data are actually stored.

[0128] In FIG. 6, the physical recording configuration of an image fileis shown on the left. A hierarchical structure is formed in a folderunit by the operating system 12 a, and an image file is stored in eachfolder. The grouping of image data in the present embodiment physicallyutilizes the hierarchical structure in just a folder unit, and adds andmanages information in the folder unit. More specifically, minimuminformation constituting the film data 30 c includes a film name whichcan be optically given, a link destination indicative of an actualstorage region as the physical arrangement information of the folder,the date for creation, a comment, a medium attribute, a medium label, afilm attribute, the number of housed image files and the like. As shown,moreover, each folder is viewed as a patrone of a film in respect of themanagement. From another viewpoint, an actual storage region is viewedas a patrone individually unconsciously. Therefore, areas management isalmost approximated. A mark indicating whether or not a physical storageregion is an exchangeable medium is displayed on the patrone to giveeasy understanding to a user. More specifically, in the case in which animage file is supplied by the CD-ROM, the storage region can beexchanged. In some cases, the CD-ROM is not attached to the actualCD-ROM drive 13 c by the exchange. In such a case, even if the CD-ROM isnot attached, non-display is not carried out. The display is carried outbased on the registered film data 30 c. In that case, an operator caneasily understand that the CD-ROM should be set for reference because ofthe exchangeable mark.

[0129] In this example, only the exchangeable mark is indicated. Such amark may be properly changed to display information. For example, themark can be changed depending on the case in which the CD-ROM isattached or not attached in the exchangeable storage region. Moreover,in the case in which image data are saved in a storage region shared bya plurality of people on a network, a mark representing a network drivemay be displayed because a confusion is caused by their rewritingoperations. As a matter of course, the network drive can be set to bewritable or unwritable. It is also possible to change the shape of thepatrone itself without changing the mark.

[0130] The specific structure of the photographic data 30 b is shown inFIGS. 5 and 6. Index information is constituted by a file name, a filedate, a file size and a photographing date. Thumb nail data obtained byscaling down the image file are displayed as a thumb nail. The commentcan be attached to each image file, and constitutes the photographicdata 30 b together with filing information indicative of a display orderand the like, position information indicative of an actual storageregion and voice information given through the microphone 18 b or thelike.

[0131] Furthermore, the photographic data 30 b also includesmodification information, feature information and color matchinginformation. As described above, the image data processing softwarecarries out the management of image data and the modification of animage. The original image data are not directly changed by themodification of the image but only a pointer for modification is managedas modification information by these parameters. Correspondingly, thefeature information and the color matching information can be managed.FIG. 7 shows a specific example of a variable declaration for managingthe modification information, which is constituted by a trimming start Xcoordinate (m_x1), a trimming start Y coordinate (m_y1), a trimming endX coordinate (m_x2) and a trimming end Y coordinate (m_y2) which aremodification enhancements about the trimming, a rotating angle(m_nRotation) for the execution of a rotation processing, automaticimage modification (m_nApf), an enhancement of a red component (m_nRed),an enhancement of a green component (m_nGreen), an enhancement of a bluecomponent (m_Blue), an enhancement of a bright component (m_nBrightness)and an enhancement of a contrast (m_nContrast).

[0132] An image processing which can be executed by the image dataprocessing software, particularly, automatic image modification will bedescribed below. The nucleus of the automatic image modification is animage modification control section 40 shown in FIG. 8. When an imagefeature extracting section 40 a extracts the feature of an image basedon the image data, a modification information creating section 40 bcreates a parameter required for modification and a modificationspecifying section 40 c causes the image processing section 20 g toexecute an actual processing by using the same parameter.

[0133]FIG. 9 typically shows a flow of the schematic procedure to beexecuted by the image modification control section 40. The automaticimage modification processing will be described below with reference tothe flow.

[0134] In a procedure 1, image data are input. The image data are readthrough the operating system 12 a and are saved in a predetermined workarea. In the case in which thumb nail data have already been created,the thumb nail data are read from the photographic data 30 b to be theimage data. The feature extraction is a summarization processing foreach pixel. Therefore, an operation time is changed depending on theamount of pixels. The thumb nail data are used to take an overwhelmingdifference in the amount of the pixels into consideration. A timerequired for the processing can be shortened as compared with the casein which the essential image data are used. The image data itself is oneof files. As shown in FIG. 10, a head portion includes profile data suchas an image size, the number of colors and the like, and a 3-byte areais then maintained for the number of pixels to express individual pixelsin RGB 256 gradations.

[0135] When the image data are read into the work area, thesummarization processing is carried out by processing the image data ofan object pixel while moving the object pixel in procedures 2 to 4 asshown in FIG. 11. The summarization processing has various contentsaccording to the feature amount of the image. In the present embodiment,the summarization processing is carried out to obtain five featureamounts of “contrast”, “lightness”, “color balance”, “color saturation”and “sharpness”. Moreover, when the summarization processing is endedfor all the pixels, the feature amount is calculated based on the resultof summarization in a procedure 5. The summarization processing and thefeature amount to be derived based thereon will be described below.

[0136] The contrast indicates the width of a luminance as the wholeimage. In the case in which the contrast is to be modified, a requestfor increasing the width of the contrast is mainly given. FIG. 12 shows,in a solid line, the distribution of a luminance in each pixel of acertain image which is summarized as a histogram. In the case in whichthe distribution shown in a solid line is taken, a small difference ismade between the luminance of a bright pixel and that of a dark pixel.If the distribution of the luminance is increased as shown in aone-dotted chain line, a great difference is made between the luminanceof the bright luminance and that of the dark pixel. Consequently, thewidth of the contrast is increased. FIG. 13 shows a luminance conversionfor enlarging a contrast. If the conversion is carried out with thefollowing relationship between a luminance y of a conversion source anda luminance Y after the conversion, a difference in a pixel between amaximum luminance Ymax and a minimum luminance Ymin of the conversionsource is increased after the conversion with a >1 so that thedistribution of the luminance is increased as shown in FIG. 12.

Y=ay+b.

[0137] Accordingly, it is necessary to carry out a summarizationprocessing by setting an interval between the maximum value of theluminance and the minimum value of the luminance as a contrast width inorder to create such a histogram. In this case, the conversion of theluminance is carried out. If the image data include a luminance as anelement, the summarization can directly be carried out. As describedabove, since the image data are expressed in RGB 256 gradations, it doesnot directly have a luminance value. In order to obtain the luminance,it is necessary to carry out color conversion in a Luv colorspecification space. However, this is not the best way in respect of anarithmetic amount and the like. Therefore, the following conversionexpression for directly calculating a luminance from RGB which has beenutilized for a television or the like is used.

y=0.30R+0.59G+0.11B

[0138] More specifically, 3 bytes to be the image data for each pixelare read while moving an object pixel, and a luminance y is calculatedbased on the expression. In this case, it is assumed that the luminancey is also expressed in 256 gradations and 1 is added to the luminance ythus calculated. The luminance is preferably utilized for the conversioninto black and white which can be implemented by making the gradationvalue of the obtained luminance with each component value of the RGB.For a single color such as a sepia tone, it is preferable that eachcomponent value of the RGB should be calculated according to a componentratio of the RGB after the gradation value of the luminance is obtained.

[0139] In the image data summarization processing of the procedure 2,the histogram of the luminance distribution is thus obtained. Based onthe histogram, both ends of the luminance distribution are obtained inthe feature amount extracting processing of the procedure 5. Theluminance distribution of a photographic image is expressed almost in aconical shape as shown in FIG. 14. As a matter course, various positionsand shapes are obtained. The width of the luminance distribution isdetermined depending on the positions of the both ends. It is impossibleto set the both ends to a point where a bottom is simply extended toobtain a distribution number of “0”. In the bottom portion, thedistribution number is displaced in the vicinity of “0” in some cases.Statistically, the distribution number transits while approaching “0” asmuch as possible.

[0140] For this reason, a portion close to the inside by a certaindistribution ratio from the maximum and minimum luminance sides withinthe distribution range is set to the both ends of the distribution. Inthe present embodiment, the distribution ratio is set to 0.5% as shown.As a matter of course, the distribution ratio can be varied properly. Bythus cutting upper and lower ends by a certain distribution ratio, it isalso possible to ignore white and black points caused by noises and thelike. More specifically, if such a processing is not carried out, onlyone white or black point becomes the both ends of the luminancedistribution. With a luminance value having 255 gradations, therefore, alowermost end has a gradation of “0” and an uppermost end has agradation of “255” in many cases. By setting, to the end, a portionclose to the inside by a pixel number of 0.5% from the upper endportion, the above-mentioned state is eliminated. Based on the actuallyobtained histogram, 0.5% for a pixel number is calculated and respectivedistribution numbers are accumulated from the luminance values on theupper and lower ends in a reproducible luminance distribution toward theinside in order. Consequently, a luminance value of 0.5% is set to amaximum luminance Ymax and a minimum luminance Ymin.

[0141] A width Ydif of the luminance distribution is a differencebetween the maximum luminance Ymax and the minimum luminance Ymin.

Ydif=Ymax−Ymin

[0142] As an image processing for enlarging a contrast, it is preferablethat a gradient a and an offset b should be determined depending on thedistribution of a luminance. For example, if

a=255/(Ymax−Ymin)

b=−a·Ymin or 255−a·Ymax,

[0143] the luminance distribution having a small width can be enlargedto a reproducible range. In the case in which the reproducible range isutilized to the maximum to enlarge the luminance distribution, ahighlight portion comes off to be white or a high shadow portion isblacked out. In order to prevent such a situation, it is preferable thata luminance value of approximately “5” should be left as a range whichis not enlarged to the upper and lower ends of the reproducible range.As a result, a parameter of the conversion expression is represented asfollows.

a=245/(Ymax−Ymin)

b=5−a·Ymin or 250−a·Ymax

[0144] In this case, it is preferable that the conversion should not becarried out with Y<Ymin and Y>Ymax.

[0145] For such a conversion, calculation is not required each time. Ifthe range of the luminance has a value of “0” to “255”, the result ofthe conversion is predetermined for each luminance value to form aconversion table as shown in FIG. 15. In this case, the luminanceconversion is carried out as a matter of course. It may be necessary toseparately take the application of image data having the RGB 256gradations into consideration. However, it is possible to actually applythe same conversion relationship as the luminance between image data(R0, G0, B0) which have not been converted and the image data (R1, G1,B1) which have been converted.

R 1 =aR 0 +b

G 1 =aG 0 +b

B 1 =aB 0 +b

[0146] The above-mentioned relationship can be obtained. As a result, itis apparent that the conversion table shown in FIG. 15 may be utilizedto carry out the conversion.

[0147] More specifically, a work for calculating the maximum luminanceYmax and the minimum luminance Ymin is equivalent to the work forextracting the feature in the procedure 5, and the processing ofcalculating the parameters a and b of the conversion expression tocreate the conversion table while calculating the width Ydif of theluminance distribution is equivalent to a modification informationcreation processing in a procedure 6. In a modification specificationprocessing in a procedure 7, such a conversion table is specified togenerate the image data (R1, G1, B1) which have been converted from theimage data (R0, G0, B0) which have not been converted.

[0148] Next, a lightness will be described. The lightness as the featureamount of an image implies an index of a contrast of the whole image,for which a median Ymed in the distribution obtained from the histogramis used. In this case, accordingly, the summarization processing iscarried out simultaneously with the summarization processing for acontrast in the procedure 2.

[0149] On the other hand, a difference (Ymed_target_Ymed) from an idealvalue Ymed_target of the lightness may be calculated when the featureamount is to be analyzed in the procedure 5. While “106” is used as theactual value of the ideal value Ymed_target, it is not fixed. Moreover,the value can also be varied depending on tastes.

[0150] In the case in which the feature amount is to be utilized tomodify the lightness, the following operation is carried out. Whether ornot an image is bright can be evaluated depending on whether or not themedian Ymed is greater than the ideal value Ymed_target. For example, ifthe median Ymed is “85”, it is smaller than the ideal value Ymed_targetof “106”. Therefore, an evaluation of “dark” is primarily obtained andthe degree of darkness is expressed in a numerical value of “106−85”secondarily.

[0151]FIG. 16 shows a histogram for a luminance. In the case in whichthe mountain of the luminance distribution is wholly close to the darkside as shown in a solid line, it is preferable that the mountain shouldbe wholly moved to the bright side as shown in a wavy line. To thecontrary, in the case in which the mountain of the luminancedistribution is wholly close to the bright side as shown in a solid lineof FIG. 17, it is preferable that the mountain should be wholly moved tothe dark side as shown in a wavy line. In such a case, the rectilinearluminance conversion shown in FIG. 13 is not carried out but a luminanceconversion utilizing a so-called γ curve shown in FIG. 18 is preferablycarried out.

[0152] In a correction using the ycurve, a brightness is whollyincreased with γ<1 and is wholly reduced with γ>1. In theabove-mentioned example, the median Ymed is coincident with the idealvalue Ymed_target if it is increased by “21”. However, it is not easy toexactly increase the median Ymed by “21” utilizing the γ Ycurve. Forthis reason, it is preferable that a corresponding value of yshould beset to an evaluation value (Ymed_target_Ymed) every “5” as shown in FIG.19. While the value of γ is varied by “0.05” corresponding to afluctuation amount “5” of the evaluation value in this example, it isapparent that their correspondence relationship can be changed properly.

[0153] Moreover, it is also possible to automatically set the value of γin the same manner as in the case in which the contrast modification iscarried out. For example,

γ=Ymed/106 or

γ=(Ymed/106)**(1/2)

[0154] may be set to calculate the value of γ. As a matter of course, itis preferable that the conversion table shown in FIG. 15 should beformed for the luminance conversion to be carried out by utilizing the γcurve.

[0155] More specifically, the work for calculating the median Ymed isequivalent to the work for extracting the feature in the procedure 5,and the work for calculating a γ correction value to create theconversion table is equivalent to the modification information creationprocessing in the procedure 6. In the modification specificationprocessing of the procedure 7, such a conversion table is specified togenerate the image data (R1, G1, B1) which have been converted from theimage data (R0, G0, B0) of each pixel which have not been converted.

[0156] Next, a color balance will be described. The color balanceindicates whether or not R, G and B components constituting the imagedata have constant imbalance tendency. For example, in the case in whicha photograph looks red, there is no problem if an actual situationduring photographing is represented. If not so, it is apparent that somebad influence is presented. Since a comparison with the actual situationshould be really carried out to confirm such an imbalance, it is alsosupposed that postevaluation itself cannot be obtained.

[0157] In the present embodiment, it is assumed that an evaluation iscarried out based on the uniformity of a frequency distribution for eachcolor. Depending on the situation during photographing, it can benatural that the frequency distribution for each color component isununiform. In such a case, color modification should not be carried out.However, following the result reversely, it can be decided that thefrequency distribution should be uniform in a situation in which thefrequency distribution of each color component is similar to some extentand the frequency distribution should not be uniform if it is notsimilar.

[0158] For this reason, a histogram for each color component is createdin order to check a degree of similarity of the frequency distributionfor each color component later in the image data summarizationprocessing in the procedure 2. At this time, the frequency distributionis not obtained for all gradation values but a 256 gradation region isdivided into 8 to 16 portions (n portions) to summarize a frequencybelonging to each region. If the region is divided into 8 portions, thefrequency distribution is obtained for eight regions of “0 to 31”, “32to 63” . . . “224 to 255” as shown in FIG. 20.

[0159] On the other hand, if the above-mentioned histogram is createdfor each color component to be intended for all pixels, vectorization iscarried out by using, as components, the pixel numbers (r1, r2 . . .rn), (g1, g2 . . . gn) and (b1, b2 . . . bn) (n=8) belonging to eachregion for each color in the analysis of the feature amount in theprocedure 5. For each of the RGB, feature vectors VR, VG and VB areexpressed as follows.

VR=(r 1, r 2 . . . rn)Σri=1

VG=(g 1, g 2 . . . gn)Σgi=1

VB=(b 1, b 2 . . . bn)Σbi=1

[0160] The cross-correlation of these feature vectors is obtained. Thecross-correlation is expressed as an inner product.

corr _(—) rg=(VR·VG)/|VR|·|VG|

corr _(—) gb=(VG·VB)/|VG|·|VB|

corr _(—) br=(VB·VR)/|VB|·|VR|

[0161] The inner product itself of vectors represents a degree ofsimilarity of both vectors and has a value of “0” to “1”. Herein, acolor balance is evaluated based on a minimum value of corr_x.

[0162] The color balance may be modified for each of the n regions thusdivided. Schematically, an image can be wholly made bright or dark foreach color component. Therefore, the RGB value can be modified byutilizing the γ value.

[0163] More specifically, the work for calculating the minimum valuecorr_x is equivalent to the work for extracting the feature in theprocedure 5, and the processing of calculating a γ correction value formodifying a balance to create a conversion table is equivalent to themodification information creation processing in the procedure 6. In themodification specification processing in the procedure 7, such aconversion table is specified to generate the image data (R1, G1, B1)which have been converted from the image data (R0, G0, B0) for eachpixel which have not been converted.

[0164] Next, a color saturation will be described. The color saturationindicates the color brightness of the whole image. For example, it isevaluated that the picture having primary colors are bright or gray.Although the color saturation itself is represented by a size from areference axis in a uv plane on the Luv color specification space, theoperation amount for converting the color specification space is largeas described above. Therefore, the color saturation of a pixel issimplified for calculation. Consequently, the color saturation iscalculated as an alternate value X in the following manner.

X=|G+B−2×R|

[0165] Originally, the color saturation has a value of “0” with R=G=B,and has a maximum value with a single color of RGB or a mixture of twoof them at a predetermined ratio. Because of this property, the colorsaturation can directly be represented properly. However, the colorsaturation has a maximum value with a single color of red or a mixedcolor of green and blue, that is, yellow by the above-mentionedsimplified equation, and has a value of “0” if each component isuniform. Moreover, the color saturation reaches approximately half ofthe maximum value for single colors of green and blue. As a matter ofcourse, the above-mentioned equation can be replaced by the followingequations.

X′=|R+B−2×G|

X″=|G+R−2×B|

[0166] In the image data summarization processing in the procedure 2,the distribution of a histogram for the alternate value X of the colorsaturation is calculated. In the case in which the distribution of thehistogram for the alternate value X of the color saturation is to becalculated, a distribution is schematically obtained as shown in FIG. 21because the color saturation is distributed within a range of a minimumvalue of “0” to a maximum value of “511”.

[0167] On the other hand, the feature amount is to be analyzed based onthe histogram in the procedure 5. Based on the summarized histogram, acolor saturation exponent for the image is determined. An upper “16%” ofa range is obtained from the distribution of the alternate value X ofthe color saturation, and a minimum color saturation “S” within thisrange represents the color saturation of the image.

[0168] If the color saturation “S” is low, a color saturationenhancement is desired. In the case in which automatic modification isto be carried out, the following operation is executed.

[0169] When each component has a component value of hue componentshaving an almost equal relationship as in the RGB color specificationspace, a gray color having no color saturation is obtained with R=G=B.If it is supposed that the component of RGB having a minimum valuesimply deteriorates a color saturation without an influence on the hueof each pixel, it is apparent that the minimum value of each componentis subtracted from all the component values and a difference value canbe increased to enhance the color saturation. If the component value ofblue (B) in each component (R, G, B) of the image data has a minimumvalue, a color saturation enhancement parameter Sratio can be used forthe following conversion.

R′=B+(R−B)×Sratio

G′=B+(G−B)×Sratio

B′=B

[0170] In this example, the component of the minimum value is simplysubtracted from other component values for the component having no colorsaturation. Other methods can also be employed for subtracting thecomponent having no color saturation. In particular, in the case inwhich the conversion is to be carried out, an enhancement in the colorsaturation gives an increase in a luminance so that a brightness tendsto be wholly increased. Accordingly, the conversion is carried out for adifference value obtained by subtracting an equivalent value of theluminance from each component value.

[0171] If the color saturation enhancement is as follows, adjustablevalues ΔR, ΔG and ΔB are calculated based on a difference value from theluminance in the following equations.

R′=R+ΔR

G′=G+ΔG

B′=B+ΔB

ΔR=(R−Y)×Sratio

ΔG=(G−Y)×Sratio

ΔB=(B−Y)×Sratio

[0172] As a result, the conversion can be obtained as follows.

R′=R+(R−Y)×Sratio

G′=G+(G−Y)×Sratio

B′=B+(B−Y)×Sratio

[0173] The luminance is clearly saved by the following equations.

Y′=Y+ΔY

[0174] $\begin{matrix}{{\Delta \quad Y} = {{0.30\Delta \quad R} + {0.59\Delta \quad G} + {0.11\quad \Delta \quad B}}} \\{= {S\quad {ratio}\quad \left\{ {\left( {{0.30\quad R} + {0.59\quad G} + {0.11B}} \right) - Y} \right\}}} \\{= 0}\end{matrix}$

[0175] More specifically, the luminance is saved after and before theconversion, and a brightness cannot be wholly obtained even if the colorsaturation is enhanced. Moreover, when an input is gray (R=G=B),aluminance Y=R=G=B is obtained. Therefore, the adjustable valueΔR=ΔG=ΔB=0 is obtained. Consequently, a color is not attached to anachromatic color.

[0176] It is preferable that the color saturation enhancement parameterSratio should be increased if an evaluation value Psatu is decreased.Based on the relationship with the above-mentioned lowest colorsaturation “S”, a color saturation enhancement exponent S′ is determinedas follows.

[0177] If S<92,

S′=−S×(10/92)+50

[0178] If 92≦S<184,

S′=−S×(10/46)+60

[0179] If 184≦S<230,

S′=−S×(10/23)+100

[0180] If 230≦S,

S=0

[0181] A conversion from the color saturation exponent S′ into the colorsaturation enhancement exponent Sratio is preferably calculated asfollows.

Sratio=(S+100)/100

[0182] In this case, when the color saturation enhancement exponent S=0is set, the color saturation enhancement parameter Sratio=1 is set,resulting in no color saturation enhancement. FIG. 22 shows therelationship between the color saturation “S” and the color saturationenhancement exponent S′.

[0183] More specifically, the work for calculating the color saturation“S” is equivalent to the work for extracting the feature in theprocedure 5, and the processing of calculating the color saturationenhancement exponent Sratio through the color saturation exponent S′ isequivalent to the modification information creation processing in theprocedure 6. In the modification specification processing in theprocedure 7, such a color saturation enhancement exponent Sratio is usedto generate the image data (R1, G1, B1) which have been converted whilecalculating a luminance from the image data (R0, G0, B0) for each pixelwhich have not been converted.

[0184] Finally, a sharpness will be described below. The sharpness asthe feature amount of an image is evaluated based on an edge degreewhich will be described below. If image data are constituted by pixelsin a dot matrix, a difference in the image data between the adjacentpixels is increased in the edge portion of the image. The difference hasa luminance gradient which will be hereinafter referred to as an edgedegree. In the case in which an XY orthogonal coordinate shown in FIG.23 is taken into consideration, a vector representing a degree of changeof the image can be operated by calculating components in the directionsof X and Y axes. In a digital image having pixels in a dot matrix, thepixels are adjacent to each other in the direction of an axis ofordinate and an axis of abscissa as shown in FIG. 24, and a brightnessis represented as f (x, y). In this case, f (x, y) may be Y (x, y) whichis a luminance or R (x, y), G (x, y) and B (x, y) which are theluminance of RGB. In FIG. 24, a difference value fx in the X directionand a difference value fy in the Y direction are represented as follows.

fx=f(x+1, y)−f(x, y)

fy=f(x, y+1)−f(x, y)

[0185] Accordingly, a vector g (x, y) having these components has thefollowing size Ddif.

Ddif=|g(x, y)|=(fx**2+fy**2)**(1/2)

[0186] The edge degree is represented by Ddif. Originally, the pixel isarranged like a measure in all directions as shown in FIG. 25. Noting acentral pixel, there are eight adjacent pixels. Accordingly, adifference in the image data between the adjacent pixels is similarlyrepresented by a vector. The sum of the vectors may be decided as adegree of change of the image. Furthermore, the operation amount can bereduced by a comparison only between simply lateral pixels.

[0187] Even if the edge degree for each pixel is calculated as describedabove, a degree of sharpness of the image cannot be obtained by simplycalculating and averaging the edge degrees of all the pixels. FIG. 26shows a photograph of an airplane flying in the sky. It is easilyapparent that the degree of change of the image is not high for the skyas a background. In such a case, it is assumed that the sky portion issubjected to trimming. Even if the image data of the airplane which is acentral subject are not changed, an average value is decreased to obtainno sharp image when the number of empty pixels is increased and isincreased to obtain a sharp image when the number of the empty pixels isdecreased. In such a case, the sharpness of the image is usually decidedbased on the sharpness of the airplane which is an original subject.Therefore, averaging is not suitable.

[0188] Consequently, the edge degrees of all the pixels are not averagedbut an edge degree for only a contour portion is averaged in order todecide a degree of sharpness of the contour portion in the image. Morespecifically, when the image data are to be summarized in the procedure2 while moving an object pixel, the edge degree is calculated asdescribed above to carry out a comparison with a certain threshold Thl,thereby deciding whether or not the pixel is an edge portion only in thecase in which the pixel is the edge portion, the edge degree Ddif isintegrated (ΣDdif) and the number of pixels in the edge portion isintegrated (ΣEdge_Pixel).

[0189] On the other hand, when the feature is to be extracted in theprocedure 5, the edge degree (ΣDdif) integrated in the procedure 2 isdivided by the number of pixels (ΣEdge_Pixel) to calculate an averagevalue Ddif_ave of the edge degree in the edge portion. As a matter ofcourse, if the average value Ddif_ave of the edge degree is increased,the sharpness of the image is more enhanced. If the average valueDdif_ave of the edge degree is small, an edge enhancement is desired. Inthe present embodiment, the following calculation is carried out. Firstof all, an edge enhancement Eenhance is calculated from the averagevalue Ddif_ave of the edge degree. As an example, the followingoperation expression can be used.

Eenhance=4×Ddif _(—) ave/100

[0190] The edge enhancement processing itself utilizes an unsharp maskshown in FIG. 27.

[0191] If the edge enhancement Eenhance is obtained, the edgeenhancement processing is executed by utilizing the unsharp mask shownin FIG. 27 for all the pixels. For a luminance Y of each pixel which isobtained before the enhancement, a luminance Y′ obtained after theenhancement is calculated as follows.

Y′=Y+Eenhance·(Y−Yunsharp).

[0192] The Yunsharp is obtained by performing an unsharp mask processingfor the image data of each pixel. The unsharp mask sets a central valueof “100” to the weighting of a pixel Y (x, y) to be processed in theimage data like a matrix, and is utilized for carrying out weightingcorresponding to a numeric value in the measure of the mask for aperipheral pixel and integration. If the unsharp mask shown in FIG. 27is utilized, the integration is carried out based on the followingoperation expression.${{{Yunshar}p}\left( {x,y} \right)} = {\left( {1/396} \right){\sum\limits_{ij}\left( {{Mij} \times {Y\left( {{x + i},{y + j}} \right)}} \right)}}$

[0193] In the above expression, “396”, is the sum of weighting factors.Moreover, Mij is a weighting factor described in the measure of theunsharp mask, Y (x, y) is image data for each pixel and ij is indicatedby coordinate values in lateral and vertical columns in the unsharpmask.

[0194] The edge enhancement operation to be carried out by utilizing theunsharp mask has the following meaning. Yunsharp (x, y) is obtained byreducing the weighting of the peripheral pixel for an attentional pixelfor addition. Therefore, so-called “unsharp” image data are obtained.Thus, the “unsharp” has the same meaning as the application of aso-called low pass filter. Accordingly, “Y(x, y)−Yunsharp(x, y)” has thesame meaning as the application of a high pass filter with a subtractionof a low frequency component from all the original components. If a highfrequency component passing through the high pass filter is multipliedby the edge enhancement Eenhance to which “Y(x, y)” is added, the highfrequency component is increased in proportion to the edge enhancementEenhance. Consequently, the edge is enhanced.

[0195] The degree of the enhancement in the edge is also varieddepending on the size of the unsharp mask. Therefore, the edgeenhancement Eenhance may be classified and the unsharp mask having acorresponding size may be prepared, thereby utilizing the unsharp maskhaving a corresponding size. As a matter of course, the edge potion ofthe image requires the edge enhancement. Therefore, an operation may becarried out in only a place where the image data are greatly variedbetween the adjacent pixels as described above. Thus, it is notnecessary to carry out the operation of the unsharp mask in most imagedata portions which are not the edge portions. Consequently, theprocessings are rapidly decreased.

[0196] The sharpness will be summarized below. The work for calculatingthe average value Ddif_ave of the edge degree is equivalent to the workfor extracting the feature in the procedure 5, and the processing ofcalculating the edge enhancement Eenhance is equivalent to themodification information creation processing in the procedure 6. In themodification specification processing in the procedure 7, such an edgeenhancement Eenhance is used to generate the image data (R1, G1, B1)having a luminance enhancement which have been converted from the imagedata (R0, G0, B0) for each pixel which have not been converted.

[0197] The processing in the image modification control section 40according to the present embodiment has been schematically describedabove. By the similar modification processing, the result ofmodification is varied by changing a target value. Accordingly, it isalso possible to select an automatic image modification processing forcausing a color to approximate to a stored color to obtain “beauty” anda “DPE” tone automatic image modification processing of increasing thesharpness enhancement and the color saturation enhancement in additionto a standard automatic image modification processing. In the automaticimage modification to match with the stored color, it is also possibleto carry out the automatic image modification in which each person feels“clear” by setting the user's taste as a standard value.

[0198] The image modification control section 40 is utilized as aso-called image modification engine. In the present image dataprocessing software, a main control section 60 serves to generallycontrol the image modification processing according to flowcharts shownin FIGS. 28 to 30 while using such an image modification engine. In thedata format having a JPEG method, picture quality is deteriorated everytime rewriting is carried out. The reason is that the processing isbased on an 8×8 block peculiar to the JPEG. A processing of reducing adistortion caused by the block is also carried out. More specifically, afilter for a smoothing processing is applied. For an edge portion, thismethod does not carry out the smoothing. By slightly carrying out suchan edge saving smoothing processing, the portion of an edge is enhanced,while the 8×8 block distortion and noises are smoothed. Even if the 8×8block distortion is reduced, the saving using the JPEG method fordeterioration causes the distortion again. In a method having nodeterioration such as BMP (bit map), a recording size is increased. Onthe other hand, in a method of managing a parameter according to thepresent embodiment, the reducing processing is carried out for an outputsuch as display or print. Therefor, it is possible to obtain imagerepresentation having the highest picture quality.

[0199] A series of image data managing processings to be carried out bythe main control section 60 include a simultaneous print processing.FIG. 34 shows screen display in the simultaneous print processing. Inthis case, the main control section 60 properly outputs an instructionto the display specifying section 20 b of the common function section 20to display the same screen on the display 17 a and to accept theoperation input of the keyboard 15 a or the mouse 15 b.

[0200] In the simultaneous print processing screen, a left portion onthe screen is an operation display area, wherein a tab is displayedalong the flow of a series of data processings. In this example, tabs of“input a photograph” “modify a photograph” “specify print” and “print”are displayed and a downward “Δ” mark is displayed therebetween. As amatter course, the data processing is carried out through the “input aphotograph” processing, the “modify a photograph” processing, the“specify print” processing and the “print” processing in this order.Thus, desirable image data can be printed clearly. Conventionally, thesame processing has been able to be executed. In that case, however, thework should have been advanced by assuming the flow of the procedure byitself.

[0201] More specifically, 1: image data are opened from a file menu, 2:an image modifying operation is specified from a tool menu to display anecessary palette and the like and to carry out desirable modificationthereon for late saving, 3: a format to be printed in a print layout isspecified from the file menu, 4: confirmation is carried out with aprint preview in the file menu, and 5: print in the file menu is finallyexecuted. As a matter of course, in the case in which a plurality ofimage data are to be printed, it is necessary to carry out a work fordetermining a print object from the file menu in this processing.

[0202] On the other hand, in the case in which a photograph picked up bythe digital still camera 11 b is to be printed, DPE simultaneous printis specified as compared with the usual photographing. A series of dataprocessings are advanced corresponding to the simultaneous printingwork. Even if an application is not well known, a series of dataprocessings can be carried out.

[0203] On a simultaneous print processing screen shown in FIG. 34,“input a photograph” is displayed. Substantially, image data managementis carried out by the film data managing section 30. A left portion in adisplay area is an operation display area dp1, and the residual displayarea is a main display area dp2, a left portion thereof is a groupdisplay region dp3 for grouping and displaying image data and theresidual portion is an image display region dp4 for displaying, with athumb nail, image data belonging to a group to be selected.

[0204] The group display region dp3 serves to display a film metaphorcorresponding to the folder unit described above, and displays a patroneof a film as a frame, and furthermore, displays a film name, a comment,a date and the number of housed image files. As a matter of course, ifthe property of each film metaphor is displayed, all information such asa film name, a link destination, a date, a comment, a medium attribute,a medium label, a film attribute and the number of housed image filesare displayed. Moreover, the group display region dp3 can properlyincrease or decrease the display region by using the GUI. If the displaycannot be sufficiently carried out in the display region, a scrolldisplay is added or a contracted display is obtained. As a matter ofcourse, an image file 30 a saved in the folder corresponding to theselected film metaphor is displayed with a thumb nail in the imagedisplay region dp4 by selectively operating any one of the displayedfilm metaphors.

[0205] In the present embodiment, the hierarchical structure of thefolder employed by the operating system 12 a is utilized to manage imagedata. Therefore, an operator can directly operate the computer system 10to house the image file 30 a in the folder. In this case, a deviation issometimes generated between the presence of the image file 30 a in thefolder and the photographic data 30 b. In this case, priority is givento the presence of the image file 30 a in the folder to properlyincrease or decrease the photographic data 30 b.

[0206] Also in this sense, it is decided whether or not there is thecorresponding photographic data 30 b based on the image file 30 apresent in the folder corresponding to the film metaphor. If there isthe photographic data 30 b, thumb nail data are used to perform adisplay. If there is not the photographic data 30 b, thumb nail data arecreated in the thumb nail creating section 20 i and the display is thencarried out. A photograph itself is longitudinally or laterally long andone thumb nail display region is a square which can house both of themand displays a serial number and an actual file name outside a frame.

[0207] In the case in which the simultaneous print is to be selected, itis supposed that image data which have just been picked up are fetchedand printed and the image data themselves are previously fetched in aconstant storage region to newly start data management as well as thecase in which the data management has already been carried out. A methodof fetching image data which have just been picked up includes the casein which the image data are fetched by cable connection from the digitalstill camera 11 b and the case in which a predetermined exchangeablerecording medium is utilized, for example. In any case, a “new film”prepared as a command button in the upper portion of a main display areaon a screen shown in FIG. 34 is executed. Consequently, two commandbuttons of “usual input” and “select an input method” can be executedand a command button of “set an input” can be executed as shown in FIG.35. If a general operator has a single digital still camera 11 b, it issupposed that image data are fetched uniformly. A method of transferringimage data which have been previously selected with the “set an input”is executed. As a matter of course, the operator has a plurality ofdigital still cameras 11 b or the image data unexpectedly need to befetched in another method in some cases. Therefore, if a command buttonof “select an input method” is executed, a plurality of methods capableof executing the fetch are displayed and selected. In these cases,external applications should be executed in some cases. By setting aninput, these are properly executed. It is apparent that a method ofspecifying an input and the like can properly be changed.

[0208] In such a state, the operator displays image data in the imagedisplay region while viewing a display in a patrone in the group displayregion to decide the group, and further selects the image data to beprinted. The selecting operation is accepted by the image selectingsection 20 a. For the selected image data, the color of the frameportion of the thumb nail display region is changed to display theselected image data. Consequently, the presence of the selection can bedecided easily. The result of the selection is reflected as an outputobject in the processings of “print” through “specify print” in additionto “modify a photograph”. In these cases, physical arrangementinformation is referred in each processing, and an actual processing isnot carried out by moving image data to be selected to a provisionalregion.

[0209] It is quite obvious that the processing of “modify a photograph”should be then carried out according to the display in an operationdisplay area by selecting the image data to be printed in the “input aphotograph”. In the “modify a photograph”, an image can be modified foronly the selected image data. FIG. 36 shows a display in a main displayarea which is obtained when the automatic image modification is to becarried out. In FIG. 36, the image of the selected image data which hasnot been modified is displayed with a thumb nail in an upper stage andan image which has been subjected to the automatic modification isdisplayed with a thumb nail in a lower stage. The operator views andcompares both of them and selects either of them which is better. As amatter of course, the selection can be carried out by clicking the thumbnail on the favorite side by means of the mouse 15 b, and the clickedside can be decided by causing the display specifying section 20 b toinvert and display a frame portion. The default which has not beenmodified is set in a selection state. Only the side clicked by the mousemay be set to the selection state after the modification. In most cases,the default which has been modified may be set to the selection state onthe assumption that the picture quality which has been modified would beselected.

[0210] In this scene, a command button of “execute” and a command buttonof “cancel” are prepared in the lowermost portion. When the commandbutton of “execute” is clicked by the mouse, the modified information ofthe photographic data 30 b prepared for each image data is updated. Asshown in FIG. 7, the management parameter of the automatic imagemodification (m_nApf) is prepared. When the image data obtained afterthe modification are selected and the command button of “execute” isclicked, a flag is set to the management parameter of the automaticimage modification (m_nApf). More specifically, even if the image dataobtained after the modification are selected, the modified image dataare not overwritten in place of the original image data but the flag ofthe management parameter is simply set. In subsequent processings,however, the management parameter is referred and it can be decided thatthe processing should be executed for the automatically modified imagedata. In some cases, the image data should be read and the image shouldbe automatically modified by the image modification control section 40.The thumb nail data in the photographic data 30 b may be updated tothumb nail data based on the modified image data and it is sufficientthat the thumb nail data may be displayed. A check box of “reflectoriginal data” is prepared under the screen. When the check box ischecked, the original image data are overwritten by the modified imagedata.

[0211] In this example, the automatic image modification is selectivelycarried out. It is preferable that such a function should be utilized.In the case in which an operation is poor, particularly, a selectingoperation cannot be known even if such a function is provided.Accordingly, it is also convenient that the automatic image modificationis carried out with the default when inputting a photograph and aprocessing of modifying the photograph is not displayed.

[0212]FIG. 37 shows an example of the screen display in that case. Asshown, a processing of “select a film” is added before the “input aphotograph” as an operation and a processing of “specify print” isexecuted after the “input a photograph”. As shown in FIG. 34, it is alsopossible to select a photograph while selecting a new film in theprocessing of “input a photograph”. In FIG. 37, the screen display ofthe “select a film” is first carried out and photographic data areselected in a patrone unit or a new film is selected earlier for easyunderstanding. Moreover, command buttons of “last step” and “next step”are prepared in an upper stage on the right portion of the screen inorder to give an instruction for advancing or returning the processingin the screen display. When the “last step” is executed, the processingis returned. When the “next step” is executed, the processing isadvanced. Furthermore, the simple description of the processing in eachstep can be displayed in the upper stage portion of the screen. Forexample, “Please select a film and proceed. A new film can be created in“add a film”” is displayed in the stage of the “select a film”.

[0213] On the other hand, manual image modification can also beselected. The degree of modification is designated by utilizing the GUI.More specifically, the GUI display is operated by means of the mouse 15b to reflect the result of the manual modification. In the presentembodiment, a stepwise enhancement processing can be executed for abrightness and a contrast in the image processing section 20 g. Based onthe premise, a parameter indicative of each enhancement degree isprepared. A parameter representing the selected result of modificationis reflected by the management parameter of an enhancement of abrightness component (m_nBrightness) and the management parameter of anenhancement of a contrast (m_nContrast).

[0214] The manual image modification is not restricted to the brightnessand the contrast but the enhancement processing can be executed for ared component, a green component and a blue component. Parametersrepresenting respective enhancement degrees are reflected by themanagement parameter of an enhancement of the red component (m_nRed),the management parameter of an enhancement of the green component(m_nGreen) and the management parameter of an enhancement of the bluecomponent (m_nBlue), respectively.

[0215] The image modification includes various processings to bereflected on the display of the image data, and also includes imagetrimming and rotation in a broad sense. When the trimming is executedwith the image data selected, image data based on the managementparameter at the present time is displayed in a frame having apredetermined size as shown in FIG. 38. When the mouse 15 b is operatedto specify a trimming start position and a trimming end position and thecommand button of “execute” is clicked, the display is carried out in aportion other than a rectangular region having the trimming startposition and the trimming end position diagonally. As a matter ofcourse, in this case, a part of the original image data is not deletedbut coordinate values are simply set to the management parameters of atrimming start X coordinate (m_x1), a trimming start Y coordinate (m_1),a trimming end X coordinate (m_x2) and a trimming end Y coordinate(m_y2). Based on the coordinate values, the thumb nail creating section20 i newly creates a thumb nail and carries out update only in thephotographic data 30 b.

[0216] On the other hand, the rotation of the screen is also referred toas image modification in a broad sense and is utilized in the case inwhich a vertical photograph picked up by setting a camera sideways ismade vertically long on the display. FIG. 39 shows the display screen ofa main display area for such a rotation processing. Original image dataare displayed with a thumb nail in an upper left portion and operationinput buttons for selecting three rotating angles every 90 degrees andan optional rotating angle are prepared under the upper left portion.Moreover, a thumb nail which is obtained with rotation by the selectedrotating angle can be displayed in a right central portion. As matter ofcourse, the selected rotating angle is set to the management parameterof the rotating angle (m_nRotation).

[0217]FIGS. 40 and 41 show a menu operation to be carried out whenspecifying the image modification. FIG. 40 is an example of the menuoperation in the case in which the automatic image modification is to becarried out. When the image modification is clicked on a menu bar, adrop down menu is displayed. When the automatic image modification isselected, a more detailed option is displayed. At this time, if “clear”is clicked, the automatic image modification is activated with an optionof “clear”. In this case, all the selected image data are displayed asshown in FIG. 36. Moreover, FIG. 41 shows an example of a menu operationin the case in which the manual image modification is carried out. Whenthe manual image modification of the drop down menu is selected whileclocking the image modification, it is possible to select modificationfor “brightness/contrast” or “modification for “color enhancement”. Itis supposed that the manual image modification which has not beenimproved by the execution of the automatic image modification is oftenexecuted individually. Only in the case in which the image data to beintended for the manual image modification are selected for activation,the manual image modification can be executed.

[0218] Moreover, trimming, rotation, black and white conversion andsepia conversion are also executed by selecting image data and thenselecting an image processing from the drop down menu. Although theblack and white conversion and the sepia tone conversion areindividually carried out, the results of the conversion are uniform. Theoperator's subjectivity is not necessary for adjustment differently fromthe manual image modification. Accordingly, the management parameter ofthe automatic image modification (m_nApf) is actually set for the blackand white conversion and the sepia tone conversion.

[0219] There has been described the situation in which the parameter isset in the process of carrying out various modifications for the imagedata when selecting the simultaneous print processing. Next, descriptionwill be given to a processing in the computer system 10 for actuallyimplementing such an operation.

[0220] FIGS. 28 to 31 are flowcharts showing each processing. FIG. 28shows a processing of executing the automatic image modification, inwhich the database structure of the photographic data 30 b is referredto read modification information when reading image data for executingthe automatic image modification at Step 100. The modificationinformation implies various parameters described above. If the automaticimage modification or the manual image modification is to be executed bythese parameters, the present processing is ended without carrying outthe following automatic image modification. The reason is that theautomatic image modification does not need to be executed repeatedly andthe automatic modification cannot be carried out if the tastes arereflected by the manual image modification.

[0221] Next, the image data are read at Step 110, the feature of theimage is extracted at Step 115, feature information is saved at Step120, the modification information about the automatic modification iscreated at Step 125, and the image processing of the automaticmodification is executed at Step 130. As a matter of course, these areequivalent to the procedures 1 to 6 as describe with reference to FIG.9. On the other hand, in the case in which the position informationabout the trimming is set to the management parameters of a trimmingstart X coordinate (m_x1), a trimming start Y coordinate (m_y1), atrimming end X coordinate (m_x2) and a trimming end Y coordinate (m_y2),an image processing for trimming is executed at Step 140 through thedecision of Step 135. If the modification information about the rotationis set to the management parameter of a rotating angle (m_nRotation) isset, the rotation image processing of rotating an image is executed atStep 150 through the decision of Step 145.

[0222] Through the above-mentioned processings, an image can be obtainedafter the automatic image modification. Therefore, a thumb nail isdisplayed before and after the modification as shown in FIG. 36 at Step155, and whether or not the result of the automatic image modificationprocessing is employed is waited to be input. More specifically, if theresult of the automatic image modification is desirable, it is set tothe selection state and the command button of “execute” is clicked. Inthis case, a selection situation in the check box of “reflect originaldata” is fetched at Step 170. If it is decided that the check has beencarried out, image data are overwritten and saved at Step 175.

[0223] If the original is to be rewritten, it is not necessary to referto the modification information. Only if the original is not rewritten,the modification information is saved at Step 180. On the other hand, inthe case in which an automatic image processing of “standard” isinsufficient, the operating condition value of the automatic imageprocessing is changed in advance at Step 165 in order to execute theautomatic image modification corresponding to the setting when “clear”,“DPE tone” or the like is selected as shown in FIG. 40. Theabove-mentioned processing is repeated at Step 115. When the commandbutton of “cancel” is clicked, it is decided that “termination” isdesired and the present processing is ended.

[0224] As a matter of course, the automatic image modification cancorrespond to various other conditions. Accordingly, the above-mentionedoperating condition value can be changed according to the user'sdesignation of “this portion should be more bright . . . ” “the wholeshould be more yellow” in addition to the selection of the “DPE tone”and the like which are prepared in advance and the above-mentionedprocessing can also be repeated. The operating condition value is notonly set later at Step 165 but also reflected when the modificationinformation about the automatic image modification is first created atthe Step 125 as a matter of course.

[0225] Next, description will be given to a processing to be carried outfor executing the manual image modification. FIG. 29 shows the manualimage modification processing. When the manual image modification isexecuted, modification information is read at Step 200 before image datato be processed are read and the same image data are then read at Step205. Subsequently, the management parameter of the automatic imagemodification (m_nApf) is referred at Step 210. If the managementparameter is set, the image processing of the automatic imagemodification is executed at Step 215 through the decision of the Step210.

[0226] At Step 220, then, the management parameter for the manual imagemodification which has already been set is read and an image processingis executed according to the designation. Thereafter, the processingsfor the trimming and the rotation are executed based on managementparameters respectively at Steps 225 to 240.

[0227] Through the above-mentioned processings, an image can be obtainedafter the manual image adjustment which has already been set. Therefore,if the manual adjustment operation is further executed as describedabove at Step 245, the modification information is changed at Step 255and the image modification is executed through the Steps 220 to 240.

[0228] Moreover, when the command button of “execute” is clicked, it isdecided that “defined” is indicated. Consequently, the original imagedata are rewritten at Step 265 or a management parameter representingfinal modification information is rewritten at Step 270 depending on theselection situation in the check box of “reflect original data”. Whenthe command button of “cancel” is clicked, it is decided that the“terminate” is decided and the present processing is ended.

[0229] Next, description will be given to a processing to be carried outfor executing the trimming. FIG. 30 shows the processing of thetrimming. Before image data to be processed are read, modificationinformation is read at Step 300 and the image data are then read at Step305. Subsequently, the management parameter of the automatic imagemodification (m_nApf) is referred at Step 310. If the managementparameter is set, the image processing of the automatic imagemodification is executed at Step 315. Moreover, various managementparameters for the manual image modification which have already been setare referred at Step 320. If the management parameters are setrespectively, a corresponding image processing is executed at Step 325.

[0230] Then, the management parameter for the trimming which has alreadybeen set is referred at Step 330, the image processing of the trimmingis executed at Step 335, the management parameter for rotation which hasalready been set is referred at Step 340, and the image processing ofthe rotation is executed at Step 345.

[0231] Through the above-mentioned processings, images can be obtainedafter the modification of all the images which have already been set.Therefore, a trimming operation is accepted on a screen display shown inFIG. 38 at Step 355. In the case in which the trimming operation isnewly carried out, the modification information is changed at Step 360and the image modification is executed through the processing of theStep 335. In this case, the management parameter for the rotation isreferred at the Step 340, and it is decided whether or not the rotationis redundant. Redundant rotation is not carried out.

[0232] Also in this case, if the command button of “execute” is clicked,it is decided that the “defined” is selected. Depending on the selectionsituation in the check box of the “reflect original data”, the originalimage data are rewritten at Step 365 or a management parameterrepresenting the final modification information is rewritten at Step370. When the command button of “cancel” is clicked, it is decided thatthe “terminate” is selected and the present processing is ended.

[0233] Finally, description will be given to a processing to be carriedout for executing the rotation. FIG. 31 shows the processing of therotation. Before image data to be processed are read, modificationinformation is read at Step 400 and the image data are then read at Step405. Subsequently, the management parameter of the automatic imagemodification (m_nApf) is referred at Step 410. If the managementparameter is set, the image processing of the automatic imagemodification is executed at Step 415. Moreover, various managementparameters for the manual image modification which have already been setare referred at Step 420. If the management parameters are setrespectively, a corresponding image processing is executed at Step 425.

[0234] Then, the management parameter for the trimming which has alreadybeen set is referred at Step 430, the image processing of the trimmingis executed at Step 435, the management parameter for a rotating angle(m_nRotation) which has already been set is referred at Step 440, andthe image processing of the rotation is executed at Step 445.

[0235] Through the above-mentioned processings, images can be obtainedafter the modification of all the images which have already been set.Therefore, a rotating operation is accepted on a screen display shown inFIG. 39 at Step 455. In the case in which the rotating operation isnewly carried out, the modification information is changed at Step 460and the image modification is executed through the processing of theStep 445.

[0236] Also in this case, if the command button of “execute” is clicked,it is decided that the “defined” is selected. Depending on the selectionsituation in the check box of “reflect original data”, the originalimage data are rewritten at Step 465 or the management parameter for therotating angle (m_nRotation) which represents the final modificationinformation is rewritten at Step 470. When the command button of“cancel” is clicked, it is decided that “terminate” is selected and thepresent processing is ended.

[0237] Thus, it is not necessary to add the change to the original imagedata as one of advantages obtained by utilizing the managementparameter. In order to make the best of the original image data, it isnecessary to modify the management parameter.

[0238] As shown in FIGS. 40 and 41, a command of image modificationcancellation is prepared in the lowermost stage of a drop down menu tobe displayed when selecting the image modification of a file menu. Whenthe same command is selected and executed, a processing is executedaccording to the flowchart shown in FIG. 32.

[0239] Also in this case, the image modification cancellation isexecuted in a state in which the image data are selected. Themodification information of the photographic data 30 b about the imagedata are read at Step 500 and an operation menu shown in FIG. 42 isdisplayed on a main display area and an operation input is waited atStep 505. In the operation menu, “automatic image modification”, “manualimage adjustment”, “rotation”, “trimming”, “black and white” and “sepiatone” are displayed as the items of a cancellation object and a checkbox is displayed before each of the items. When the operator clicks thecheck box provided before the image modification item to be canceled bymeans of the mouse 15 b, a check mark is toggle displayed and thepresence of the respective check marks is represented by a flag and isstored internally. In the lower stage, a command button of “execute” anda command button of “cancel” are prepared. After checking the necessarycheck box, the operator clicks the command button of “execute”.

[0240] Consequently, corresponding modification information is deletedwhile deciding whether or not a check mark is attached to each check boxat and after Step 510. As a matter of course, the deletion of themodification information implies the modification of the managementparameter. It is not necessary to process the original image data atall. More specifically, it is decided whether or not the check mark isattached to the item of “automatic image modification” at Step 510. Ifthe check mark is attached, the modification information of “automaticimage modification” is deleted at Step 515. Next, it is decided whetheror not the check mark is attached to the item of “black and white” atStep 520. If the check mark is attached, the modification information of“black and white” is deleted at Step 525. Then, it is decided whether ornot the check mark is attached to the item of “sepia tone” at Step 530.If the check mark is attached, the modification information of “sepiatone” is deleted at Step 535. Thereafter, it is decided whether or notthe check mark is attached to the item of “manual image modification” atStep 540. If the check mark is attached, the modification information of“manual image modification” is deleted at Step 545. The manual imagemodification includes a lightness, a contrast and a color enhancement.While all of them are canceled in this example, they may be canceledindividually.

[0241] Next, it is decided whether or not the check mark is attached tothe item of “trimming” at Step 550. If the check mark is attached, themodification information of “trimming” is deleted at Step 555.Subsequently, it is decided whether or not the check mark is attached tothe item of “rotation” at Step 560. If the check mark is attached, themodification information of “rotation” is deleted at Step 565.

[0242] In the state in which some of the modification information aredeleted through the above-mentioned results, the modificationinformation are saved at Step 570. The saving work implies the update ofthe photographic data 30 b. By giving access to the database structureof the photographic data 30 b shown in FIG. 5, the newest modificationinformation is obtained by updating. When the command button of “cancel”is clicked on the operation menu shown in FIG. 42, all the check marksare internally deleted and the above-mentioned processings are executed.Therefore, the present processing is ended without deleting any of themodification information after all. While this example has employed themethod of deleting the modification information once created to returnthe original information, information about a date is added to themodification information itself to manage a plurality of modificationinformation corresponding to one image data in time series.Consequently, the modification information is simply deleted to returnthe original data, and furthermore, it is possible to delete themodification information by going back to an optional stage and it isalso possible to reconstitute the results of the modification which havebeen good in the middle stage.

[0243] While the description has been given to the work for setting orcanceling the management parameter prepared corresponding to each imagedata, a processing capable of utilizing actually modified image data byusing the management parameter will be described with reference to theflowchart shown in FIG. 33.

[0244] The modified image data are utilized in the case in which thethumb nail creating section 20 i updates a thumb nail according to aninstruction given from the display specifying section 20 b and carriesout a screen display, the case in which the data format style of theimage data is converted and output by the image output section 20 k, thecase in which the original print data are created when print is to becarried out by the DPE print control section 50 as will be describedbelow and the like. Accordingly, although respective processings haveslight differences, they are almost coincident with the flowchart ofFIG. 33.

[0245] The modification information of object image data are read atStep 600 and image data are read at Step 605 to perform imagemodification based on the image data according to the modificationinformation in the following processings. Consequently, new image dataare created without rewriting the image data. It is decided whether ornot there is modification information about the automatic imagemodification at Step 610. If there is the modification information, theautomatic image modification is carried out at Step 615. In this case,the management parameter of the automatic image modification (m_nApf)includes the information about the automatic image modification, andfurthermore, decides whether or not the automatic image modificationsuch as “standard”, “clear” and “DPE tone” is carried out and thenadvances the processing. Moreover, since there is only one result ofmodification, the conversion to the black and white and the sepia toneis represented by the management parameter of the automatic imagemodification. Thus, the processing is carried out simultaneously oralternatively.

[0246] Subsequently, it is decided whether or not there is modificationinformation of manual adjustment at Step 620. If there is themodification information, the image processing of manual adjustment iscarried out at Step 625. As described above, the modificationinformation of the manual adjustment includes an enhancement of a brightcomponent (m_nBrightness), an enhancement of a contrast (m_nContrast),an enhancement of a red component (m_nRed), an enhancement of a greencomponent (m_nGreen) and an enhancement of a blue component (m_Blue). Ifthere is any of the modification information, a corresponding imageprocessing is carried out. If there are the modification informationabout a brightness and a contrast and modification information about acolor enhancement, the former is modified and the latter is thenmodified. As a matter of course, in the case in which the result of thereflection on such a modification order is obtained, the modificationcan also be carried out only once.

[0247] Then, it is decided whether or not there is the modificationinformation about the trimming at Step 630. If there is the modificationinformation about the trimming, the image processing of the trimming iscarried out at Step 635. In the image processing of the trimming, anarea surrounded by a trimming start X coordinate (m_x1), a trimmingstart Y coordinate (m_y1), a trimming end X coordinate (m_x2) and atrimming end Y coordinate (m_y2) is left and the peripheral image dataare deleted.

[0248] Moreover, it is decided whether or not there is the modificationinformation about rotation at Step 640. If there is the modificationinformation about rotation, the image processing of the rotation iscarried out at Step 645. In the image processing of the rotation, arotating angle is referred based on the management parameter of therotating angle (m_nRotation) and the processing of rotating the imagedata is carried out.

[0249] Referring to the above-mentioned image processings, the originalimage data are first saved in a work area again and the image data onthe work area are altered. Accordingly, the original image data are notaltered.

[0250] While an optional image processing which is executed or is notexecuted depending on the user's selecting operation has been describedabove, essential image processings are executed based on a difference ina hardware environment at Steps 650 and 655. At the Step 650, an imageprocessing of color reproduction depending on an output apparatus iscarried out. It cannot be denied that a color output reproducingapparatus has a deviation from a reference. In many cases, a differenceis made on the result of an output by the input of the same image data.In respect of a simple expense to cost, it is impossible to make thedeviation uniform such that the image data and the result of the outputare always coincident with a standard state. It is better that colormatching information for modification is utilized by the anticipation ofthe deviation.

[0251] In the above-mentioned image data, it is apparent that a greatcolor deviation is not generated in the result of the output if thereare color deviation information on the photographing side and colordeviation information on the output side. In the present embodiment, theformer color deviation information is managed as the color matchinginformation in the database structure of the photographic data 30 b andis managed, in set information, as color deviation information generatedin the computer system 10 and the color printer 17 b. At the Step 650,the image data on the work area are modified based on the both colordeviation information.

[0252] At the Step 655, the image processing having a resolutioncorresponding to the output apparatus is executed to carry outcorresponding resolution conversion by comparing the resolution of theimage data with a resolution for output. For example, in the case inwhich a display on the color display 17 a has a resolution of 70 dpi andprinting is to be carried out according to the size, it is necessary toperform resolution conversion 10 times as much in all the directions ifthe color printer 17 b has a resolution of 720 dpi.

[0253] Returning to the description of the simultaneous print processingshown in FIG. 34, the “specify print” processing is carried out afterthe modification of a photograph. The “input a photograph” and “modify aphotograph” have been passed, and the image data to be printed have beenselected and the image processing for the printing has been selected. Inthe “specify print”, a format for printing the selected image data isspecified.

[0254]FIG. 43 shows a display in the main display area for the “specifyprint”. In an upper stage portion, a display area which can be scrolledin the transverse direction is provided so that a layout pattern can bedisplayed. In FIG. 43, layouts of “a layout every four pieces”, “albumprint” and “seal print” are displayed. As a matter of course, it ispossible to mount other layout patterns. Moreover, a check box isprovided as an option in order to select the print of a register mark tobe a target of a position for cutting, the print of a date and the printof a title. Furthermore, a paper corresponds to “A4”, “B5”, “seal” andthe like, any of which can be selected exclusively by means of a radiobutton.

[0255] When printing is to be carried out, it is necessary to generateprint data depending on the type of the color printer 17 b. Therefore,the selection display area of a printer device is provided on the leftin the lower stage. By selecting the printer device, corresponding setinformation are read respectively to modify the above-mentioned colordeviation or to cause the output resolutions to be coincident with eachother.

[0256] The layout of “album print” is prepared in the layout. When acommand button of “album particulars” is clicked, an operation screenshown in FIG. 44 is displayed in the main display area. Also in thedisplay screen, a display area which can be scrolled in the transversedirection is provided in the upper stage portion and the pattern of thealbum can be displayed. In this example, the A4 paper is provided in twolateral columns and four vertical stages to print an image checkerwise,is provided on the left half in the four vertical stages to print animage and is divided into vertically upper and lower stages to print animage. Moreover, a check box is provided such that the print of acomment, the print of a date or that of a page title can be selected asoptions for album printing, and a specification column for a page numberis also provided such that a serial page number can be printed becausethe printing is sequentially carried out day by day for the album print.For the page number, the succeeding page number of the last album printmay be set automatically. If the exact display is enough, a commandbutton of “OK” is clicked. If the display is not satisfied, a commandbutton of “cancel” is clicked.

[0257] The final processing of the simultaneous print shown in FIG. 34is “print”. In the main display area, a message for confirmation isdisplayed including the type of the printer device which is beingspecified, the size of a print paper, and the necessary number of sheetsas shown in FIG. 45, and furthermore, a command button of “execute” forstarting the print and a command button of “cancel” are prepared. As amatter of course, when the command button of “execute” is clicked inthis state, the print is started. Depending on the color printer 17 b along time is often required for the printing. Therefore, if all theoperations to be specified in advance are completed and the button of“execute” is clicked, the print can easily be completed after taking thebath.

[0258]FIG. 46 shows the specific structure of the DPE print controlsection 50 for executing such “print specification” and “print”processings. The print image specifying section 50 a takes over thespecification of image data selected as described above, and theprocessing of “print specification” is executed by the frame specifyingsection 50 b and the layout specifying section 50 c. Consequently,actual print data are generated by a print style creating section 50 eand a print image processing section 50 f under the control of the printspecifying section 50 d. In general, the image data are displayed inmultigradation display of RGB. On the other hand, the print is oftencarried out in two gradation display of CMYK. Consequently, the printimage processing section 50 f executes the image processingcorresponding to the above-mentioned specification, changes a colorspace of RGB→CMYK and executes a multigradation→two gradation conversionprocessing.

[0259] In the case in which a plurality of modification information aresaved in time series for one image data, it is sufficient that a historyis displayed when deleting the modification, thereby carrying out thedeletion by going back one by one. As a matter of course, in the case inwhich there are modified data in case series, the image processing issequentially carried out from the oldest data to reproduce image data tobe utilized. Moreover, in the case in which the modification is to beadded, modification information is newly generated and the previousmodification information is left and saved.

[0260] <Second Embodiment>

[0261] On the other hand, FIG. 47 shows the above-mentioned hierarchicalstructure in a folder unit more specifically. First of all, film data 30c are saved as a database file ai_dpe. db0 of a “main” folder 31 inwhich a main program of an image data processing apparatus is stored.Since the same folder as in the main program is used, a correspondenceof a patrone to a folder is important information to be a nucleus. It ispossible to prevent the resultant dissipation by changing a placeaccording to a user's optional designation. Next, an image file 30 asaved in an exchangeable storage region such as a CD-ROM 13 c-1 is savedas database files photo1. db1, photo1. db2, photo2. db1 and photo2. db2in a “removable” folder 32 having photographic data 30 b formed in the“main” folder 31 in order to manage the photographic data 30 b in apatrone unit. The names of photol and photo2 are attached to one patroneand two files having extensions of db1 and db2 attached thereto aregenerated respectively. Any of the two database files which has theextension of db2 is a special file for a thumb nail in the photographicdata 30 b, and the residual photographic data 30 b are stored in thefile having the extension of db1. In this example, accordingly, one setof database files photol. db1 and photol. db2 constitute thephotographic data 30 b.

[0262] On the other hand, in the case in which the image file 30 a is tobe saved on a hard disk 13 b, it is saved in a “films” folder 33 formedin the “main” folder 31. One folder is further formed for each patronein the “films” folder 33. When “swimming in the sea” is set as the nameof the patrone, a “swimming in the sea” folder 34 is obtained. When“hiking” is set as the name of the patrone, a “hiking” folder 35 isobtained. Database files ai_dpe. db1 and ai_dpe. db2 are created as thephotographic data 30 b in the respective folders and individual imagefiles 30 a are saved with unique names. As described earlier, the thumbnail data are saved in either of the two database files which has theextension of db2, and the residual photographic data are saved in thedatabase file having the extension of db1. Moreover, information aboutonly the image file 30 a saved in the same directory is stored in thedatabase file and so is the “hiking” folder 35 as a matter of course.

[0263] For the reasons of the processing, it is convenient that there isa patrone which saves temporarily inseparable data, and a patrone havingthe name of “others” is prepared. The image file 30 a classified for thepatrone of “others” is saved in the same column as the above-mentioned“swimming in the sea” folder 34 and “hiking” folder” 35 which areprovided under the “films” folder 33. Similarly, database files ai_dpe.db1 and ai_dpe. db2 which are intended for the image film present in thesame directory are created.

[0264] Thus, the image files 30 a are present on an exchangeablerecording medium or the hard disk 13 b, and are managed in a patroneunit respectively and the places of presence are intensively managed ina database file ai_dpe. db0 of the “main” folder 31. The information isstored as a link destination in the database file ai_dpe. db0. If thelink destination is on the hard disk 13 b, one directory is kept and theimage file 30 a is saved together with the photographic data 30 b. Ifthe link destination is on the exchangeable recording medium, only thephotographic data 30 b are intensively saved in one directory. In thecase in which the photographic data 30 b and the image file 30 a are notpresent in the same directory, that is, are on the exchangeablerecording medium, the names of the database files of photol. db1 andphotol. db2 to be the photographic data 30 b are also saved in the filmdata 30 c. The reason is that the photographic data 30 b having aplurality of patrones are saved on one directory. On the other hand, inthe case in which the photographic data 30 b and the image file 30 a arein the same directory, the names of ai_dpe. db1 and ai_dpe. db2 to bethe photographic data 30 b are not particularly important. The reason isthat one directory is kept for each patrone and only one set of databasefiles ai_dpe. db1 and ai dpe. db2 are present. As a matter of course,the name of the directory corresponds to that of the patrone. Therefore,the location is also specified with the name of the patrone.

[0265] There are various methods of linking the image file 30 a to thephotographic data 30 b. While one set of database files are formed for aplurality of image files 30 a in the above-mentioned example, it is alsopossible to carry out dispersion in a file unit. In FIG. 48, oneattribute file “0616000x. ATB” including the above-mentionedmodification information, feature information, color matchinginformation and the like is generated as the photographic data 30 b forone image file “0616000x. jpg”. In this case, one directory is generatedfor one patrone, and an image file 30 a group and an attribute file 30 dgroup are saved in each directory. When treating the image file 30 a,first of all, it is decided whether or not the attribute file 30 d andthe image file 30 a in each directory correspond at a ratio of one toone. If they are coincident with each other, the thumb nail data in theattribute file 30 d are used to execute simple display and variousoperation processings. In this case, the attribute file 30 d isspecified by the location of the director written to the file data 30 cand the name of each image file 30 a. Therefore, these informationconstitute link information of the image file 30 a and the modificationinformation.

[0266] As another example in which the database file is not generated,it is also possible to generate a file in which the image file 30 aandthe photographic data 30 bare integrated. FIG. 49(a) shows an example ofa directory structure obtained in that case. On the premise that oneimage file “0616000x. jpg” is present, one file “10616000x. PHT”including the photographic data 30 b is generated. In this case, thephotographic data 30 b belong on the premise that the image file 30 a ispresent. Therefore, the correspondence is coincident differently fromthe case of other files.

[0267] Moreover, version up for a modification processing is anticipatedand spare information to cope with other changes which cannot beanticipated are required. FIG. 49(b) shows an example in whichinformation indicative of the version of an image modifying engine isincluded corresponding to the version up of the modification processing.Herein, there is generated a file “xxxx. PHT” integrated by an imagefile “xxxx. jpg” and an information file “xxxx. ENG” indicative of theversion of an image modifying engine in addition to photographic data“xxxx. ATB”.

[0268]FIG. 50 shows a specific example to be carried out in the case inwhich such a folder structure is employed. As described above, the usualresult of a modification processing is reflected on only the thumb nailand the original image file 30 a is not modified. Accordingly, it isnecessary to carry out the modification processing on the actual imagefile 30 a in the case of equal magnification display and enlargementdisplay or print. As a matter of course, temporary work image data 30 aare obtained as the result of the modification.

[0269] On the premise of the above-mentioned file structure, descriptionwill be given to a work image file generation processing shown in FIG.50. When the simultaneous print processing in FIG. 34 is being executed,it is necessary to display the image file with an equal magnification orwith enlargement in order to check the result of the modification duringthe execution. In the case in which the print is finally executed, theimage file reflected on the result of the modification is required. Inthe work image file generation processing shown in FIG. 50, a work imagefile is generated in such a case.

[0270] This processing is implemented as one module or the like. Inorder to call the module, an image file is specified under the selectionof a certain patrone. As shown in FIG. 51, accordingly, the selectioninformation about the patrone is prepared in a variable PATRONE and avariable f_PICT indicative of the presence of the selection for theimage file 30 a held in each patrone is prepared. The variable f_PICT isa 1000-byte character region. Each byte is selection information foreach image file 30 a, and the presence of the selection of approximately1000 image files 30 a can be specified. An argument can be given torefer to one byte in an optional location. Based on the information, thepresence of the selection of each image file 30 a is decided.

[0271] First of all, the film data 30 c of the patrone selected from thevariable PATRONE is referred with the database file ai_dpe. db0 of the“main” folder 31 at Step 700. The film data 30 c includes a mediumattribute and a link destination for the patrone. At the Step 700,accordingly, the link destination is acquired. At Step 705, it isdecided whether or not a recording medium is exchangeable from themedium attribute, that is, is removable and the processing is branched.In the case in which the recording medium is removable, a correspondingremovable recording medium is first attached at Step 707. Morespecifically, a path name to be the link destination of the removablerecording medium and a medium label are acquired to promote the user toset the recording medium to a predetermined drive. If the recordingmedium is set, whether or not the setting is correct is confirmed. Ifthe setting is incorrect, the user is promoted to try it again. If thesetting is completed, a corresponding database file in a “removable”folder 32 is referred at Step 710. With the database files photol. db1and photol. db2, the modification information of each image filespecified based on the specification information based on the variablef_PICT is acquired therefrom.

[0272] In the case in which the recording medium is not removable basedon the medium attribute, a folder having the name of the patrone issearched in the films folder 33 at Step 715 and the data base filesai_dpe. db1 and ai_dpe. db2 in the corresponding folder are referred.Then, modification information of each image file specified based on thespecification information in the variable f_PICT is acquired from thedatabase file.

[0273] Thus, the location of the image file 30 a, the modificationinformation corresponding thereto and the like can be acquired. At Step720, the modification processing is executed by the image modifyingengine corresponding based on the specified modification information atStep 720, and furthermore, an original enlargement display or printprocessing is executed at Step 725. The Step 725 may be executed fromthe module or the processing may be carried out after it is oncereturned to a high order module.

[0274] On the other hand, a thumb nail image is displayed in an imagedisplay region dp4 in a state in which the patrone is selected. In thiscase, a thumb nail display processing shown in FIG. 52 is carried out.Also in this case, first of all, the film data 30 c of the patroneselected based on the variable PATRONE at Step 730 are referred in thedatabase file ai_dpe. db0 of the “main” folder 31, and a mediumattribute and a link destination about the patrone are acquired from thefilm data 30 c. It is decided whether or not a recording medium isexchangeable from the medium attribute, that is, removable. If therecording medium is removable, thumb nail data are acquired from thedatabase file photol. db2 in the “removable” folder 32 at Step 740. Ifthe recording medium is not removable based on the medium attribute, afolder having the name of the patrone is searched in the films folder 33at Step 745, thereby acquiring the thumb nail data from the databasefile ai_dpe. db2 in the corresponding folder. Then, the thumb nail datathus acquired are displayed in an image display region dp4 at Step 750.

[0275] Next, description will be given to a processing capable ofoptionally changing the order of an image processing. FIG. 53 shows thecontents of the modification information in the photographic data 30 bin this case. The contents of the processing include “automatic imageadjustment”, “brightness”, “contrast”, “red (enhancement)”, “green(enhancement)” and “blue (enhancement)” as shown in the leftmost column.For each processing, individual specified information to be set include“version of modifying engine”, “order (execution order information)” and“processing intensity” as shown in the uppermost column.

[0276] The “automatic image modification” has a fixed execution order ofthe each processing content. Therefore, only if the “automatic imagemodification” is not selected, the order is effective in the otherprocessings. In FIG. 53(a), “1” is set to the order of the automaticimage modification and “0” is set to the other processings which impliesno selection. On the other hand, in FIG. 53(b), “0” is set to the orderof the automatic image modification which is not selected. The order of“1” to “5” is set to the other processings.

[0277]FIG. 54 is a flowchart for executing the modification processingof an image in the case in which such a processing order is attached. Atstep 760, first of all, a sort for each processing order is executed. Asdescribed above, if the processing is not selected, “0” is attached. Asa result of an ascending order sort, therefore, a processing which isnot selected comes up to the head. At Step 765, “0” is attached to thecolumn of order and the processing arranged on the head is eliminated.For example, only the automatic image processing is left in FIG. 53(a)and only the automatic image processing is eliminated in FIG. 53(b). Theprocessing objects are arranged in order of a red enhancement, a greenenhancement, a blue enhancement, a brightness and a contrast.

[0278] At Step 770, it is decided whether or not the loop is ended. Ifthere is not a processing object, the modification processing is ended.If there is a processing object, processings are executed at Steps 775and 780. At the Step 775, the image data and the parameter of theprocessing intensity are transferred to a processing engine for aprocessing taking a priority, thereby executing the modificationprocessing. The processing taking a priority is sorted and arranged onthe head and is a first processing for the read enhancement in theexample of FIG. 53(b).

[0279] After the processing is carried out, processings which have notbeen carried out are moved up at Step 780. First of all, the processingfor the red enhancement takes a priority. When the processing isterminated, the processing for the red enhancement is eliminated and asecond processing for a blue enhancement takes a priority. Similarly,the succeeding processings are moved up. By the processings thus movedup, the processings are executed in order until a final processing isended. The processing to be executed is finally gone and the loopprocessing is ended.

[0280]FIG. 55 conceptually shows the processing to be carried out at theStep 775. The image modification control section 40 includes a pluralityof image modifying engines on the premise that it is utilized as aso-called image modifying engine. As shown, a version 1 (41) and aversion 2 (42) are provided as a modifying engine for the automaticimage modification, a version 1 (43) and a version 2 (44) are similarlyprovided as a modifying engine for the brightness modification, aversion 1 (45) is provided as a modifying engine for the contrastmodification and so are others. As shown in FIG. 55 at the Step 775,when the version of the processing engine, the image data and theprocessing intensity are specified as parameters for the imagemodification control section 40, the image modification control section40 executes, on the image data, the image modification as specified tooutput the image data thus modified.

[0281] More specifically, modifying engines 41 to 45 . . . correspondingto the contents of the parameter are selected in the image modificationcontrol section 40 and the parameter is given thereto, thereby executingthe image modification. As a matter of course, the image modificationcontrol section 40 itself is constituted as a module aggregate of alarge number of modules, and a module for a specific modifying engine isexecuted through a branch processing.

[0282] Thus, the element of the order is set as one of parameters of themodification information and sorting is executed. Consequently, themodification processing can be carried out in desirable order withoutexecuting unnecessary processings.

[0283] On the other hand, the respective processings of “automatic imagemodification”, “brightness”, “contrast”, “red (enhancement)”, “green(enhancement)” and “blue (enhancement)” can be grouped and usedseparately. For example, they can be formed into three groups, that is,a first group having the “automatic image modification”, a second grouphaving the “brightness” and the “contrast” and a third group having the“red (enhancement)”, the “green (enhancement)” and the “blue(enhancement)”. The first group originally requires a feature extractionprocessing, a modification information creation processing, and amodification specification processing and should be implemented as aseries of processings. Moreover, the second group has a main object toconvert a luminance as the contents of the processing and has acommunity. Furthermore, the third group implements an enhancementprocessing for each color component and has common processing contents.

[0284] Accordingly, in the case in which an execution environment has amargin, for example, a CPU has a high processing capability, thespecification of all the groups can be executed and the third group canbe implemented depending on the execution environment, while the firstand second groups cannot be implemented. Whether or not the first tothird groups can be executed is determined by environment setting or thelike and whether or not each of the modifying engines 41 to 45 . . . canbe executed is referred based on execution information by an executiondeciding section 46 of the image modification control section 40.Although the modifying engine is executed for the processing of thegroup which can be executed, the modifying engine is not executed forthe processing of the group which cannot be executed and the processingis ended in the mane manner as the completion of the processing.

[0285] While a set of photographic data 30 b have been mainly describedabove, it is also possible to employ a structure having plural sets asin the above-mentioned history information. FIG. 56 shows an example ofthe contents of the photographic data 30 b in the case in which pluralsets of modification information are provided. For the contents, pluralsets of modification information shown in FIGS. 53(a) and 53(b) areprovided.

[0286] Each set is referred to as a first group. FIG. 57 is a flowchartshowing a processing to be carried out in the case in which thephotographic data 30 b have a plurality of groups. First of all, it isnecessary to save a plurality of groups because only one specificationof the modification is provided.

[0287] Image data to be modified are selected at Step 800, modificationto be executed is concretely specified at Step 805 and the specifiedmodification is executed at Step 810. As a matter of course, the imagemodification at the Step 810 is executed for thumb nail datarepresenting the original image file 30 a. The way of giving aninstruction is the same as described above.

[0288] Next, an inquiry is made to a user as to whether or not theinstruction for modification given at the Step 805 is saved at Step 815.The inquiry is displayed on a display 17 a by using a GUI and causes amouse 15 b or a keyboard 15 a to respond. If the instruction formodification is to be saved, the specification of a saving group isinput at Step 820. Five saving groups are previously set to be selected,any of which is input through the GUI. As a matter of course, the numberof the saving groups is optional. It is also possible to add the savinggroup in order without determining a constant upper limit.

[0289] When the saving group is determined, the modification informationis written at Step 830. As such a manner that the number of the groupsis determined in advance, a predetermined case may be caused tocorrespond to each group. For example, the first group corresponds to amodification processing for a slide show and the second groupcorresponds to a modification processing for printing. Moreover, wheneach group is to be selected, specification may be given individually,for example, the group is set to the slide show or the printing. Step825 represents a processing of causing the group to correspond to theconditions for execution, and is not essential.

[0290] When the modification information is written, the thumb nail dataare also written at Step 840. The thumb nail data are necessary for eachgroup, and are additionally written to the database file of thephotographic data 30 b which has an extension of db2.

[0291]FIG. 58 shows the modification processing to be carried out when aplurality of groups are registered as described above. On the premise ofthe modification processing shown in FIG. 54, it is decided whether ornot the modification information of a plurality of groups are saved atStep 850 and any of the groups is selected at Step 855 only if there area plurality of groups. If there are not a plurality of groups, defaultspecification is given to the existing group at Step 860. At Step 855 orStep 860, one group is specified as modification information. Therefore,processings at and after the Step 800 shown in FIG. 57 are executed.

[0292] In this example, plural sets of whole parameters are prepared andany of the sets is selected. However, the plural sets of wholeparameters are not always prepared but a plurality of processingpatterns can also be prepared for a part of the image processings as amatter of course. For example, a plurality of columns for the processingintensity are prepared in FIGS. 53 and 56 and the column to be set isspecified in the same manner as in the specification of the saving groupat the Step 820. When reading, the set for reading is selected at Step855 if a plurality of values are set to a plurality of columns at theStep 850.

[0293] On the other hand, the condition of execution is sometimesattached to the group to be saved as described above. In this case, themodification processing is executed according to a flowchart shown inFIG. 59. More specifically, it is decided whether or not there are aplurality of groups at Step 870 and a current environment is acquired atStep 875 if there are a plurality of groups. This environmentcorresponds to the above-mentioned conditions. More specifically, it isdecided whether the slide show or the print processing is being executedby referring to a predetermined variable or a flag. Any variable can bereferred. As an example, a global variable JOKEN may be set. If thecurrent condition is acquired, a group corresponding to this conditionis selected at Step 880. In the following, processings at and after theStep 800 shown in FIG. 57 are executed.

[0294] Thus, when the modification processing is executed, the conditionof the execution is set. Consequently, when a processing such as displayor print is activated, the environment is automatically decided. If themodification processing is previously set for the environment, acorresponding modification processing is automatically carried out. Forexample, in the slide show, it is necessary to prevent an originaldisplay interval from being exceeded during the modification of animage. Accordingly, it is desirable that a time required for theprocessing should be shortened and the processing is to be simplified.On the other hand, high picture quality is desired even if a long timeis required for the printing. Therefore, the desirable modificationprocessing can be carried out.

[0295] From such a background, effectively, a group for modifying only abrightness and a contrast which can be processed comparatively simply isregistered in place of the automatic image modification in the slideshow and a group is registered to execute the automatic imagemodification in the printing.

[0296] Next, FIG. 60 is a flowchart to be utilized for a history byusing such a plurality of groups. At Steps 900 to 910, predeterminedimage data are selected and modified in the same manner as in theabove-mentioned Steps 800 to 810. Then, whether or not the modificationinstruction is saved is selected at Step 915. If the modificationinstruction is saved, a group of the newest modification information isadded at Step 920. For example, if there are three existing groups, thegroup is saved as a fourth one. At this time, a modification date or thelike may be added as one of the information. At Step 925, correspondingthumb nail data are added to a predetermined database file in the samemanner as in the Step 840 and the like.

[0297] For the history, new modification should be executed on the pastmodification. FIG. 61 is a flowchart for a modification processing to becarried out when there is modification information for the history.First of all, a sort is executed in order of the execution of a group atStep 930. Usually, a group having a greater number is newer modificationinformation and is not essential. However, a specification may bealtered or the information about the modification date may be saved asdescribed above. Therefore, it is significant that the sort can beexecuted.

[0298] If the sort is completed, the number of groups is set to avariable g_total at Step 935, and “1” is set to a loop pointer i at Step940. Then, the modification processing is carried out based on themodification information of a group i indicated by the loop pointer i atStep 945. “1” is sequentially added to the loop pointer i at Step 950.Therefore, the modification processing is carried out in order from asmaller group number and a newer history is reproduced in order. At Step955, it is decided whether or not the loop pointer i exceeds the numberof existing groups. As long as the loop pointer i does not exceed thenumber of groups, a loop is repeated on the assumption that there areunprocessed modification processings.

[0299] On the other hand, it is not the premise that the modificationprocessing is executed for only a part of the image data. As a matter ofcourse, the modification processing can also be executed for a part ofthe image data in addition to the whole image data. A part of the imagedata implies a part of an image region or a part of layers if the imageis constituted by a plurality of layers.

[0300]FIG. 62 is a flowchart showing the case in which such amodification region is specified to implement image modification. Whenimage data to be processed are selected at Step 960, a modificationregion is specified at Step 965, an instruction for the modification isgiven at Step 970 and an image is modified at Step 975. Thespecification of the region and the contents of the modificationproperly repeat trial and error in many cases. Therefore, the order ofthe processings at Steps 965 to 975 represents only the relative orderof execution.

[0301] At Step 980, whether or not an instruction for modification issaved is inquired. If the instruction for modification is to be saved,it is saved as modification information together with information abouta region at Step 985.

[0302] It is apparent that the modification region thus saved is onlyone parameter for the modifying engine. As shown in FIG. 55,accordingly, modification is partially added corresponding to a regionand a layer on the modifying engine side, and modified image data areoutput.

[0303] In the case in which a concrete specific region is to bedesignated for the specification of the modification region, thecoordinate values of two diagonal corners can be designated or everyobject in a rectangular region or a desirable region can be designatedin an optional curve, for example. Moreover, it is also possible todesignate a central part, an upper half or a lower half of the wholeregion.

[0304] On the other hand, it is also possible to specify the color of animage to correspond to an image processing. For example, a chromaticitywhich is rarely influenced by a brightness can also be designated tocorrespond to an image processing, for example. It is supposed that mostobjects are human faces in a skin color region. The blurred human facelooks more beautiful than the sharp human face. Accordingly, thechromaticity of the skin color is specified in place of the regioninformation and an instruction for decreasing a sharpness (blurring) isgiven as an instruction for modification. On the modifying engine side,the chromaticity of a pixel to be processed is identified and theprocessing intensity is made unsharp as designated with an objectchromaticity.

[0305] As another example of each chromaticity, it is also suitable thatthe chromaticity of a blue sky should be specified to make anunsharpness. Moreover, it is also suitable that a processing ofenhancing red should be specified in consideration of the bright colorsof the sunset.

[0306] If image data of each pixel are expressed by (R, G, B), thechromaticity is represented as follows.

r=R/(R+G+B)

b=B/(R+G+B)

[0307] The chromaticity is rarely affected even if a human skin looksdark or bright, and has a constant distribution. More specifically, thedecision can be carried out by the following expression.

0.33<r<0.51

|0.74r+b−0.57|<0.1

[0308] If this condition can be applied to each pixel, the chromaticitybelongs to the skin color region. In consideration of a greaterfluctuation width of the blue sky than the skin color, it is preferablethat the following expression should be established.

0.17<r<0.30

|1.11r+b−0.70|<0.2

[0309] In order to execute the optimum image processing depending on thesituation of a pixel, for example, the position of a pixel, the color ofa pixel and the like, a parameter corresponding to the situation of thepixel is related and saved. When the parameter is acquired, an imageprocessing corresponding to the situation of the pixel is executed toreproduce an image.

[0310] Thus, image data are housed in a folder to be managed as a filmmetaphor and the database of the photographic data 30 b corresponding toeach image data is prepared. When a desirable image processing isselected for desirable image data, the selected image processing isupdated as modification information in the database structure. Whendisplay, output or print is actually required, the modificationinformation is referred on only a work area with original image dataleft, thereby executing various image processings. Therefore, it ispossible to easily execute the image modification and the like withimage data left as an original.

Industrial Applicability

[0311] As described above, the present invention can provide an imagedata processing apparatus capable of easily utilizing a result of animage processing while leaving original image data when carrying out theimage processing on image data.

[0312] According to the second aspect of the present invention,moreover, an image data set relating at least the parameter to the imagedata can be created. According to the third aspect of the presentinvention, if such an image data set is present, it is possible toreproduce the desirable result of the image processing which is set.

[0313] According to the fourth aspect of the present invention, thecontents of the image processing can be represented more specifically.Consequently, the reproducibility can also be maintained easily.

[0314] According to the fifth aspect of the present invention, moreover,the results of reproduction of a plurality of correspondences can besubstantially prepared and the results of the reproduction can beselected depending on the situation.

[0315] According to the sixth aspect of the present invention,furthermore, it is possible to provide an optimum image processingresult in consideration of execution conditions and the like.

[0316] According to the seventh aspect of the present invention,moreover, it is possible to increase variation by an irreversible imageprocessing with the reproduction of execution order or to reproduce animage processing process.

[0317] According to the eighth aspect of the present invention,furthermore, a plurality of results of the image processing can beobtained by only the individually prepared parameters. Therefore, it ispossible to provide a plurality of image data without greatly increasinga file capacity.

[0318] According to the ninth aspect of the present invention, moreover,it is possible to apply a more proper image processing depending on thesituation of a pixel.

[0319] According to the tenth aspect of the present invention,furthermore, it is possible to easily carry out relating by utilizingthe hierarchical structure.

[0320] According to the eleventh aspect of the present invention,moreover, the burden of the processing can be relieved by utilizing thethumb nail data.

[0321] According to the twelfth aspect of the present invention,furthermore, it is possible to carry out an optimum correspondence inconformity with the saving situation of the image data, andparticularly, to implement the correspondence of a parameter to a writedisable region or image data which are not preferable for writing.

[0322] According to the thirteenth aspect of the present invention,moreover, the parameter can be set automatically.

[0323] According to the fourteenth aspect of the present invention,furthermore, the image processing section is prepared corresponding tothe image processing. Consequently, the image reproduction processingcan be simply implemented. Moreover, the image processing section andthe like provided on the outside can easily execute the imagereproduction processing.

[0324] According to the fifteenth aspect of the present invention,moreover, it is possible to provide a medium recording an image data setcapable of producing the same effects. According to the sixteenth totwenty-ninth aspects of the present invention, it is possible to providea medium recording an image data processing program capable of producingthe same effects. According to the thirtieth to thirty-sixth aspects ofthe present invention, it is possible to provide an image dataprocessing method.

1. An image data processing apparatus comprising: a parameter settingunit which sets a parameter representing contents of a predeterminedimage processing to be executed on image data; a data saving unit whichsaves the image data and the parameter together with relatinginformation; a data acquiring unit which acquires the image data and theparameter by referring to the relating information; and an imageprocessing reproducing unit which obtains image data subjected to thespecified image processing based on the acquired image data andparameter.
 2. An image data processing apparatus comprising: a parametersetting unit which sets a parameter representing contents of apredetermined image processing to be executed on image data; and a datasaving unit which saves the image data and the parameter together withrelating information.
 3. An image data processing apparatus in which aparameter representing contents of a predetermined image processing tobe executed on image data and the image data are saved together withmutual relating information, the apparatus comprising; a data acquiringunit which acquires the image data and the parameter by referring to therelating information; and an image processing reproducing unit whichobtains image data subjected to the specified image processing based onthe acquired image data and parameter.
 4. The image data processingapparatus according to any of claims 1 to 3, wherein the parameterrepresents a type or degree of an image processing.
 5. The image dataprocessing apparatus according to any of claims 1 to 3, wherein thereare a plurality of parameters every image processing type.
 6. The imagedata processing apparatus according to claim 1 or 3, wherein a pluralityof parameters can be saved and execution can selectively be performedfrom the parameters.
 7. The image data processing apparatus according toany of claims 1 to 3, 5 and 6, wherein the parameter includes executionorder information for carrying out an image processing in predeterminedorder.
 8. The image data processing apparatus according to any of claims1 to 3, wherein the parameter is divided into a plurality of selectablesets, and an image processing is carried out based on a set ofparameters which are selected during execution.
 9. The image dataprocessing apparatus according to any of claims 1 to 3, wherein theparameter is divided into a plurality of sets and the sets of parametersare separately used depending on a situation of a pixel.
 10. The imagedata processing apparatus according to any of claims 1 to 3, wherein thedata saving unit can partition a storage region as a hierarchicalstructure and the image data and the parameter are divided with thehierarchical structure.
 11. The image data processing apparatusaccording to any of claims 1 to 3, wherein the data saving unit relatesand saves thumb nail data of the image data together with the parameter.12. The image data processing apparatus according to any of claims 1 to3, wherein the image data are managed on a storage device differentlyfrom the parameter.
 13. The image data processing apparatus according toany of claims 1 to 3, wherein the parameter setting unit sets contentsof an image processing based on a result obtained by statisticallyanalyzing the image data.
 14. The image data processing apparatusaccording to claim 1 or 3, wherein the image processing reproducing unitselects an image processing section to execute an image processingrepresented by the parameter and executes the image processing.
 15. Amedium recording an image data set recording: image data; a parameterrepresenting contents of a predetermined image processing such that theimage processing can be carried out for corresponding image data; andrelating information for relating the image data to the parameter suchthat the contents of the image processing represented by the parametercan be executed on the image data.
 16. A medium recording an image dataprocessing program for causing a computer to execute an image processingon image data, comprising: a parameter setting step of setting aparameter representing contents of a predetermined image processing tobe executed on image data; a data saving step of saving the image dataand the parameter together with relating information; a data acquiringstep of acquiring the image data and the parameter by referring to therelating information; and an image processing reproducing step ofobtaining image data subjected to the specified image processing basedon the acquired image data and parameter.
 17. A medium recording animage data processing program for causing a computer to execute an imageprocessing on image data, comprising: a parameter setting step ofsetting a parameter representing contents of a predetermined imageprocessing to be executed on image data; and a data saving step ofsaving the image data and the parameter together with relatinginformation.
 18. A medium recording an image data processing program forcausing a computer to execute an image processing on image data, aparameter representing contents of a predetermined image processing tobe executed on image data and the image data being saved together withmutual relating information, the medium comprising; a data acquiringstep of acquiring the image data and the parameter by referring to therelating information; and an image processing reproducing step ofobtaining image data subjected to the specified image processing basedon the acquired image data and parameter.
 19. The medium recording animage data processing program according to any of claims 16 to 18,wherein the parameter represents a type or degree of an imageprocessing.
 20. The medium recording an image data processing programaccording to any of claims 16 to 18, wherein there are a plurality ofparameters every image processing type.
 21. The medium recording animage data processing program according to any of claims 16 to 18,wherein a plurality of parameters can be saved and execution canselectively be performed from the parameters.
 22. The medium recordingan image data processing program according to any of claims 16 to 18, 20and 21, wherein the parameter includes execution order information forcarrying out an image processing in predetermined order.
 23. The mediumrecording an image data processing program according to any of claims 16to 18, wherein the parameter is divided into a plurality of selectablesets, and an image processing is carried out based on a set ofparameters which correspond to execution conditions.
 24. The mediumrecording an image data processing program according to any of claims 16to 18, wherein the parameter is divided into a plurality of sets and thesets of parameters are separately used depending on a situation of apixel.
 25. The medium recording an image data processing programaccording to any of claims 16 to 18, wherein the data saving steputilizes a storage region which can be partitioned as a hierarchicalstructure and the image data and the parameter are divided with thehierarchical structure.
 26. The medium recording an image dataprocessing program according to any of claims 16 to 18, wherein the datasaving step relates and saves thumb nail data of the image data togetherwith the parameter.
 27. The medium recording an image data processingprogram according to any of claims 16 to 18, wherein the image data areread and written on a storage device differently from the parameter atthe data saving step and the data acquiring step.
 28. The mediumrecording an image data processing program according to any of claims 16to 18, wherein the parameter setting step sets contents of an imageprocessing based on a result obtained by statistically analyzing theimage data.
 29. The medium recording an image data processing programaccording to any of claims 16 to 18, wherein the image processingreproducing step selects an image processing program to execute an imageprocessing represented by the parameter and executes the imageprocessing.
 30. An image data processing method in which a parameterrepresenting contents of a predetermined image processing to be executedon image data is set, the image data and the parameter are savedtogether with relating information, and the image data and the parameterare acquired by referring to the relating information, and image datasubjected to the specified image processing are obtained based on theacquired image data and parameter.
 31. An image data processing methodin which a parameter representing contents of a predetermined imageprocessing to be executed on image data is set and the image data andthe parameter are saved together with relating information.
 32. An imagedata processing method in which a parameter representing contents of apredetermined image processing to be executed on image data and theimage data are saved together with mutual relating information, and theimage data and the parameter are acquired by referring to the relatinginformation, and image data subjected to the specified image processingare obtained based on the acquired image data and parameter.
 33. Theimage data processing method according to claim 30, wherein thumb naildata of the image data are related and saved together with theparameter.
 34. The image data processing method according to any ofclaims 30 to 32, wherein the image data are managed on a storage devicedifferently from the parameter.
 35. The image data processing methodaccording to any of claims 30 to 32, wherein the image data arestatistically analyzed and contents of an image processing are set basedon a result of the analysis.
 36. The image data processing methodaccording to claim 30 or 32, wherein an image processing section isselected to execute an image processing represented by the parameter andis caused to execute the image processing.